User interfaces for managing media

ABSTRACT

The present disclosure generally relates to user interfaces for displaying representations of media (an image, video).

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No.17/354,376, filed on Jun. 22, 2021, titled “USER INTERFACES FOR MANAGINGMEDIA,” which is a continuation of U.S. patent application Ser. No.17/027,484, now U.S. Pat. No. 11,054,973, filed on Sep. 21, 2020, titled“USER INTERFACES FOR MANAGING MEDIA,” which claims priority to U.S.Provisional Patent Application Ser. No. 63/032,871, filed on Jun. 1,2020, titled “USER INTERFACES FOR MANAGING MEDIA,” the contents of whichare hereby incorporated by reference in their entireties.

FIELD

The present disclosure relates generally to computer user interfaces,and more specifically to techniques for managing media.

BACKGROUND

Users of smartphones and other personal electronic devices arefrequently capture, store, and edit media for safekeeping memories andsharing with friends. Some existing techniques allowed users to capturemedia, such as images, audio, and/or videos. Users can manage such mediaby, for example, capturing, storing, and editing the media.

BRIEF SUMMARY

Some user interfaces for managing media using electronic devices,however, are generally cumbersome and inefficient. For example, someexisting techniques use a complex and time-consuming user interface,which may include multiple key presses or keystrokes. Existingtechniques require more time than necessary, wasting user time anddevice energy. This latter consideration is particularly important inbattery-operated devices.

Accordingly, the present technique provides electronic devices withfaster, more efficient methods and interfaces for managing media. Suchmethods and interfaces optionally complement or replace other methodsfor managing media. Such methods and interfaces reduce the cognitiveburden on a user and produce a more efficient human-machine interface.For battery-operated computing systems, such methods and interfacesconserve power and increase the time between battery charges.

In some examples, the present technique enables users of computersystems to capture and display media in a time-efficient andinput-efficient manner, thereby reducing the amount of processing thedevice needs to do. In some examples, the present technique manages thebrightness of regions of the user interface, thereby saving batterylife.

In accordance with some embodiments, a method is described. The methodis performed at a computer system having one or more cameras, whereinthe computer system is in communication with a display generationcomponent and one or more input devices. The method comprises: receivinga request to display a camera user interface; and in response toreceiving the request to display the camera user interface and while theone or more cameras are configured to capture images based on a firstexposure compensation value, displaying, via the display generationcomponent, a camera user interface that includes: displaying, via thedisplay generation component, a first representation of a field-of-viewof the one or more cameras; and in accordance with a determination thata set of exposure compensation criteria is met, wherein the set ofexposure compensation criteria includes a criterion that is met when anexposure compensation mode is enabled, displaying, concurrently with therepresentation of the field-of-view of the one or more cameras, anexposure compensation indicator that includes: a representation of thefirst exposure compensation value; and a visual indication that thecomputer system has determined that clipping is predicted to occur inresponse to receiving a request to capture media that corresponds to therepresentation of the field-of-view of the one or more cameras.

In accordance with some embodiments, a non-transitory computer-readablestorage medium is described. The non-transitory computer-readablestorage medium stores one or more programs configured to be executed byone or more processors of a computer system having one or more cameras,wherein the computer system is in communication with a displaygeneration component and one or more input devices, the one or moreprograms including instructions for: receiving a request to display acamera user interface; and in response to receiving the request todisplay the camera user interface and while the one or more cameras areconfigured to capture images based on a first exposure compensationvalue, displaying, via the display generation component, a camera userinterface that includes: displaying, via the display generationcomponent, a first representation of a field-of-view of the one or morecameras; and in accordance with a determination that a set of exposurecompensation criteria is met, wherein the set of exposure compensationcriteria includes a criterion that is met when an exposure compensationmode is enabled, displaying, concurrently with the representation of thefield-of-view of the one or more cameras, an exposure compensationindicator that includes: a representation of the first exposurecompensation value; and a visual indication that the computer system hasdetermined that clipping is predicted to occur in response to receivinga request to capture media that corresponds to the representation of thefield-of-view of the one or more cameras.

In accordance with some embodiments, a transitory computer-readablestorage medium is described. The transitory computer-readable storagemedium stores one or more programs configured to be executed by one ormore processors of a computer system having one or more cameras, whereinthe computer system is in communication with a display generationcomponent and one or more input devices, the one or more programsincluding instructions for: receiving a request to display a camera userinterface; and in response to receiving the request to display thecamera user interface and while the one or more cameras are configuredto capture images based on a first exposure compensation value,displaying, via the display generation component, a camera userinterface that includes: displaying, via the display generationcomponent, a first representation of a field-of-view of the one or morecameras; and in accordance with a determination that a set of exposurecompensation criteria is met, wherein the set of exposure compensationcriteria includes a criterion that is met when an exposure compensationmode is enabled, displaying, concurrently with the representation of thefield-of-view of the one or more cameras, an exposure compensationindicator that includes: a representation of the first exposurecompensation value; and a visual indication that the computer system hasdetermined that clipping is predicted to occur in response to receivinga request to capture media that corresponds to the representation of thefield-of-view of the one or more cameras.

In accordance with some embodiments, a computer system is described. Thecomputer system comprises: one or more cameras; one or more processors,wherein the computer system is in communication with a displaygeneration component and one or more input devices; and memory storingone or more programs configured to be executed by the one or moreprocessors, the one or more programs including instructions for:receiving a request to display a camera user interface; and in responseto receiving the request to display the camera user interface and whilethe one or more cameras are configured to capture images based on afirst exposure compensation value, displaying, via the displaygeneration component, a camera user interface that includes: displaying,via the display generation component, a first representation of afield-of-view of the one or more cameras; and in accordance with adetermination that a set of exposure compensation criteria is met,wherein the set of exposure compensation criteria includes a criterionthat is met when an exposure compensation mode is enabled, displaying,concurrently with the representation of the field-of-view of the one ormore cameras, an exposure compensation indicator that includes: arepresentation of the first exposure compensation value; and a visualindication that the computer system has determined that clipping ispredicted to occur in response to receiving a request to capture mediathat corresponds to the representation of the field-of-view of the oneor more cameras.

In accordance with some embodiments, a computer system is described. Thecomputer system comprises: means for receiving a request to display acamera user interface; and means, responsive to receiving the request todisplay the camera user interface and while the one or more cameras areconfigured to capture images based on a first exposure compensationvalue, for displaying, via the display generation component, a camerauser interface that includes: means for displaying, via the displaygeneration component, a first representation of a field-of-view of theone or more cameras; and means, in accordance with a determination thata set of exposure compensation criteria is met, wherein the set ofexposure compensation criteria includes a criterion that is met when anexposure compensation mode is enabled, for displaying, concurrently withthe representation of the field-of-view of the one or more cameras, anexposure compensation indicator that includes: a representation of thefirst exposure compensation value; and a visual indication that thecomputer system has determined that clipping is predicted to occur inresponse to receiving a request to capture media that corresponds to therepresentation of the field-of-view of the one or more cameras.

In accordance with some embodiments, a method is described. The methodis performed at a computer system that is in communication with adisplay generation component and one or more input devices. The methodcomprises: displaying, via the display generation component, a mediaviewer user interface that includes: a first portion that includes arepresentation of a first previously captured media item; and a secondportion that has a first visual appearance and that is different fromthe first portion of the media viewer user interface; while displaying,via the display generation component, the media viewer user interfacethat includes the second portion of the media viewer user interface thathas the first visual appearance, receiving a request to display arepresentation of a second previously captured media item that isdifferent from the first previously captured media item; and in responseto receiving the request to display the representation of the secondpreviously captured media item: in accordance with a determination thata first set of criteria is met, wherein the first set of criteriaincludes a criterion that is met when the representation of the secondpreviously captured media item is a high-dynamic-range (HDR) media item:displaying the representation of the second previously captured mediaitem; and updating the second portion of the media viewer user interfaceto have a second visual appearance that is different from the firstvisual appearance.

In accordance with some embodiments, a non-transitory computer-readablestorage medium is described. The non-transitory computer-readablestorage medium storing one or more programs configured to be executed byone or more processors of a computer system, wherein the computer systemis in communication with a display generation component and one or moreinput devices, the one or more programs including instructions for:displaying, via the display generation component, a media viewer userinterface that includes: a first portion that includes a representationof a first previously captured media item; and a second portion that hasa first visual appearance and that is different from the first portionof the media viewer user interface; while displaying, via the displaygeneration component, the media viewer user interface that includes thesecond portion of the media viewer user interface that has the firstvisual appearance, receiving a request to display a representation of asecond previously captured media item that is different from the firstpreviously captured media item; and in response to receiving the requestto display the representation of the second previously captured mediaitem: in accordance with a determination that a first set of criteria ismet, wherein the first set of criteria includes a criterion that is metwhen the representation of the second previously captured media item isa high-dynamic-range (HDR) media item: displaying the representation ofthe second previously captured media item; and updating the secondportion of the media viewer user interface to have a second visualappearance that is different from the first visual appearance.

In accordance with some embodiments, a transitory computer-readablestorage medium is described. The transitory computer-readable storagemedium stores one or more programs configured to be executed by one ormore processors of a computer system, wherein the computer system is incommunication with a display generation component and one or more inputdevices, the one or more programs including instructions for:displaying, via the display generation component, a media viewer userinterface that includes: a first portion that includes a representationof a first previously captured media item; and a second portion that hasa first visual appearance and that is different from the first portionof the media viewer user interface; while displaying, via the displaygeneration component, the media viewer user interface that includes thesecond portion of the media viewer user interface that has the firstvisual appearance, receiving a request to display a representation of asecond previously captured media item that is different from the firstpreviously captured media item; and in response to receiving the requestto display the representation of the second previously captured mediaitem: in accordance with a determination that a first set of criteria ismet, wherein the first set of criteria includes a criterion that is metwhen the representation of the second previously captured media item isa high-dynamic-range (HDR) media item: displaying the representation ofthe second previously captured media item; and updating the secondportion of the media viewer user interface to have a second visualappearance that is different from the first visual appearance.

In accordance with some embodiments, a computer system is described. Thecomputer system comprises: one or more processors, wherein the computersystem is in communication with a display generation component and oneor more input devices; and memory storing one or more programsconfigured to be executed by the one or more processors, the one or moreprograms including instructions for: displaying, via the displaygeneration component, a media viewer user interface that includes: afirst portion that includes a representation of a first previouslycaptured media item; and a second portion that has a first visualappearance and that is different from the first portion of the mediaviewer user interface; while displaying, via the display generationcomponent, the media viewer user interface that includes the secondportion of the media viewer user interface that has the first visualappearance, receiving a request to display a representation of a secondpreviously captured media item that is different from the firstpreviously captured media item; and in response to receiving the requestto display the representation of the second previously captured mediaitem: in accordance with a determination that a first set of criteria ismet, wherein the first set of criteria includes a criterion that is metwhen the representation of the second previously captured media item isa high-dynamic-range (HDR) media item: displaying the representation ofthe second previously captured media item; and updating the secondportion of the media viewer user interface to have a second visualappearance that is different from the first visual appearance.

In accordance with some embodiments, a computer system is described. Thecomputer system comprises: means for displaying, via the displaygeneration component, a media viewer user interface that includes: afirst portion that includes a representation of a first previouslycaptured media item; and a second portion that has a first visualappearance and that is different from the first portion of the mediaviewer user interface; means, while displaying, via the displaygeneration component, the media viewer user interface that includes thesecond portion of the media viewer user interface that has the firstvisual appearance, for receiving a request to display a representationof a second previously captured media item that is different from thefirst previously captured media item; and in response to receiving therequest to display the representation of the second previously capturedmedia item: means, in accordance with a determination that a first setof criteria is met, wherein the first set of criteria includes acriterion that is met when the representation of the second previouslycaptured media item is a high-dynamic-range (HDR) media item: fordisplaying the representation of the second previously captured mediaitem; and updating the second portion of the media viewer user interfaceto have a second visual appearance that is different from the firstvisual appearance.

In accordance with some embodiments, a method is described. The methodis performed at a computer system having a first media-capturing device,wherein the computer system is in communication with a displaygeneration component and one or more input devices. The methodcomprises: receiving an indication that the first media-capturing devicehas been activated; and in response to receiving the indication that thefirst media-capturing device has been activated: in accordance with adetermination that, while activated, the first media-capturing devicerecorded data of a first type, displaying, via the display generationcomponent, a graphical indicator that indicates activation of the firstmedia-capturing device; and in accordance with a determination that,while activated, the first media-capturing device recorded data of asecond type without recording data of the first type, forgoing displayof the graphical indicator that indicates activation of the firstmedia-capturing device.

In accordance with some embodiments, a non-transitory computer-readablestorage medium is described. The non-transitory computer-readablestorage medium stores one or more programs configured to be executed byone or more processors of a computer system having a firstmedia-capturing device, wherein the computer system is in communicationwith a display generation component and one or more input devices, theone or more programs including instructions for: receiving an indicationthat the first media-capturing device has been activated; and inresponse to receiving the indication that the first media-capturingdevice has been activated: in accordance with a determination that,while activated, the first media-capturing device recorded data of afirst type, displaying, via the display generation component, agraphical indicator that indicates activation of the firstmedia-capturing device; and in accordance with a determination that,while activated, the first media-capturing device recorded data of asecond type without recording data of the first type, forgoing displayof the graphical indicator that indicates activation of the firstmedia-capturing device.

In accordance with some embodiments, a transitory computer-readablestorage medium is described. The transitory computer-readable storagemedium stores one or more programs configured to be executed by one ormore processors of a computer system having a first media-capturingdevice, wherein the computer system is in communication with a displaygeneration component and one or more input devices, the one or moreprograms including instructions for: receiving an indication that thefirst media-capturing device has been activated; and in response toreceiving the indication that the first media-capturing device has beenactivated: in accordance with a determination that, while activated, thefirst media-capturing device recorded data of a first type, displaying,via the display generation component, a graphical indicator thatindicates activation of the first media-capturing device; and inaccordance with a determination that, while activated, the firstmedia-capturing device recorded data of a second type without recordingdata of the first type, forgoing display of the graphical indicator thatindicates activation of the first media-capturing device.

In accordance with some embodiments, a computer system is described. Thecomputer system comprises: a first media-capturing device, wherein thecomputer system is in communication with a display generation componentand one or more input devices; one or more processors; memory storingone or more programs configured to be executed by the one or moreprocessors, the one or more programs including instructions for:receiving an indication that the first media-capturing device has beenactivated; and in response to receiving the indication that the firstmedia-capturing device has been activated: in accordance with adetermination that, while activated, the first media-capturing devicerecorded data of a first type, displaying, via the display generationcomponent, a graphical indicator that indicates activation of the firstmedia-capturing device; and in accordance with a determination that,while activated, the first media-capturing device recorded data of asecond type without recording data of the first type, forgoing displayof the graphical indicator that indicates activation of the firstmedia-capturing device.

In accordance with some embodiments, a computer system is described. Thecomputer system comprises: a first media-capturing device means forreceiving an indication that the first media-capturing device has beenactivated; and means, responsive to receiving the indication that thefirst media-capturing device has been activated, for: in accordance witha determination that, while activated, the first media-capturing devicerecorded data of a first type, displaying, via the display generationcomponent, a graphical indicator that indicates activation of the firstmedia-capturing device; and in accordance with a determination that,while activated, the first media-capturing device recorded data of asecond type without recording data of the first type, forgoing displayof the graphical indicator that indicates activation of the firstmedia-capturing device.

Executable instructions for performing these functions are, optionally,included in a non-transitory computer-readable storage medium or othercomputer program product configured for execution by one or moreprocessors. Executable instructions for performing these functions are,optionally, included in a transitory computer-readable storage medium orother computer program product configured for execution by one or moreprocessors.

Thus, devices are provided with faster, more efficient methods andinterfaces for managing media, thereby increasing the effectiveness,efficiency, and user satisfaction with such devices. Such methods andinterfaces may complement or replace other methods for managing media.

DESCRIPTION OF THE FIGURES

For a better understanding of the various described embodiments,reference should be made to the Description of Embodiments below, inconjunction with the following drawings in which like reference numeralsrefer to corresponding parts throughout the figures.

FIG. 1A is a block diagram illustrating a portable multifunction devicewith a touch-sensitive display in accordance with some embodiments.

FIG. 1B is a block diagram illustrating exemplary components for eventhandling in accordance with some embodiments.

FIG. 2 illustrates a portable multifunction device having a touch screenin accordance with some embodiments.

FIG. 3 is a block diagram of an exemplary multifunction device with adisplay and a touch-sensitive surface in accordance with someembodiments.

FIG. 4A illustrates an exemplary user interface for a menu ofapplications on a portable multifunction device in accordance with someembodiments.

FIG. 4B illustrates an exemplary user interface for a multifunctiondevice with a touch-sensitive surface that is separate from the displayin accordance with some embodiments.

FIG. 5A illustrates a personal electronic device in accordance with someembodiments.

FIG. 5B is a block diagram illustrating a personal electronic device inaccordance with some embodiments.

FIGS. 6A-6V illustrate exemplary user interfaces for managing exposurecompensation in accordance with some embodiments.

FIG. 7 is a flow diagram illustrating exemplary methods for managingexposure compensation in accordance with some embodiments.

FIGS. 8A-8L illustrate exemplary user interfaces for displaying media inaccordance with some embodiments.

FIG. 9 is a flow diagram illustrating exemplary methods for displayingmedia in accordance with some embodiments.

FIG. 10A-10AC illustrate exemplary user interfaces for displaying astatus indicator in accordance with some embodiments.

FIG. 11 is a flow diagram illustrating exemplary methods for displayinga status indicator in accordance with some embodiments.

DESCRIPTION OF EMBODIMENTS

The following description sets forth exemplary methods, parameters, andthe like. It should be recognized, however, that such description is notintended as a limitation on the scope of the present disclosure but isinstead provided as a description of exemplary embodiments.

There is a need for electronic devices that provide efficient methodsand interfaces for managing media, such as the methods described hereinto capture media using exposure compensation, display media, and displayan indicator of the status of media. Such techniques can reduce thecognitive burden on a user who manages media, thereby enhancingproductivity. Further, such techniques can reduce processor and batterypower otherwise wasted on redundant user inputs.

Below, FIGS. 1A-1B, 2, 3, 4A-4B, and 5A-5B provide a description ofexemplary devices for performing the techniques for managing media.

FIGS. 6A-6V illustrate exemplary user interfaces for managing exposurecompensation in accordance with some embodiments. FIG. 7 is a flowdiagram illustrating exemplary methods for managing exposurecompensation in accordance with some embodiments. The user interfaces inFIGS. 6A-6V are used to illustrate the processes described below,including the processes in FIG. 7.

FIGS. 8A-8L illustrate exemplary user interfaces for displaying media inaccordance with some embodiments. FIG. 9 is a flow diagram illustratingexemplary methods for displaying media in accordance with someembodiments. The user interfaces in FIGS. 8A-8L are used to illustratethe processes described below, including the processes in FIG. 9.

FIGS. 10A-10AC illustrate an exemplary user interfaces for displaying astatus indicator in accordance with some embodiments. FIG. 11 is a flowdiagram illustrating exemplary methods for displaying a status indicatorin accordance with some embodiments. The user interfaces in FIGS.10A-10AC are used to illustrate the processes described below, includingthe processes in FIG. 11.

Although the following description uses terms “first,” “second,” etc. todescribe various elements, these elements should not be limited by theterms. These terms are only used to distinguish one element fromanother. For example, a first touch could be termed a second touch, and,similarly, a second touch could be termed a first touch, withoutdeparting from the scope of the various described embodiments. The firsttouch and the second touch are both touches, but they are not the sametouch.

The terminology used in the description of the various describedembodiments herein is for the purpose of describing particularembodiments only and is not intended to be limiting. As used in thedescription of the various described embodiments and the appendedclaims, the singular forms “a,” “an,” and “the” are intended to includethe plural forms as well, unless the context clearly indicatesotherwise. It will also be understood that the term “and/or” as usedherein refers to and encompasses any and all possible combinations ofone or more of the associated listed items. It will be furtherunderstood that the terms “includes,” “including,” “comprises,” and/or“comprising,” when used in this specification, specify the presence ofstated features, integers, steps, operations, elements, and/orcomponents, but do not preclude the presence or addition of one or moreother features, integers, steps, operations, elements, components,and/or groups thereof.

The term “if” is, optionally, construed to mean “when” or “upon” or “inresponse to determining” or “in response to detecting,” depending on thecontext. Similarly, the phrase “if it is determined” or “if [a statedcondition or event] is detected” is, optionally, construed to mean “upondetermining” or “in response to determining” or “upon detecting [thestated condition or event]” or “in response to detecting [the statedcondition or event],” depending on the context.

Embodiments of electronic devices, user interfaces for such devices, andassociated processes for using such devices are described. In someembodiments, the device is a portable communications device, such as amobile telephone, that also contains other functions, such as PDA and/ormusic player functions. Exemplary embodiments of portable multifunctiondevices include, without limitation, the iPhone®, iPod Touch®, and iPad®devices from Apple Inc. of Cupertino, Calif. Other portable electronicdevices, such as laptops or tablet computers with touch-sensitivesurfaces (e.g., touch screen displays and/or touchpads), are,optionally, used. It should also be understood that, in someembodiments, the device is not a portable communications device, but isa desktop computer with a touch-sensitive surface (e.g., a touch screendisplay and/or a touchpad). In some embodiments, the electronic deviceis a computer system that is in communication (e.g., via wirelesscommunication, via wired communication) with a display generationcomponent. The display generation component is configured to providevisual output, such as display via a CRT display, display via an LEDdisplay, or display via image projection. In some embodiments, thedisplay generation component is integrated with the computer system. Insome embodiments, the display generation component is separate from thecomputer system. As used herein, “displaying” content includes causingto display the content (e.g., video data rendered or decoded by displaycontroller 156) by transmitting, via a wired or wireless connection,data (e.g., image data or video data) to an integrated or externaldisplay generation component to visually produce the content.

In the discussion that follows, an electronic device that includes adisplay and a touch-sensitive surface is described. It should beunderstood, however, that the electronic device optionally includes oneor more other physical user-interface devices, such as a physicalkeyboard, a mouse, and/or a joystick.

The device typically supports a variety of applications, such as one ormore of the following: a drawing application, a presentationapplication, a word processing application, a website creationapplication, a disk authoring application, a spreadsheet application, agaming application, a telephone application, a video conferencingapplication, an e-mail application, an instant messaging application, aworkout support application, a photo management application, a digitalcamera application, a digital video camera application, a web browsingapplication, a digital music player application, and/or a digital videoplayer application.

The various applications that are executed on the device optionally useat least one common physical user-interface device, such as thetouch-sensitive surface. One or more functions of the touch-sensitivesurface as well as corresponding information displayed on the deviceare, optionally, adjusted and/or varied from one application to the nextand/or within a respective application. In this way, a common physicalarchitecture (such as the touch-sensitive surface) of the deviceoptionally supports the variety of applications with user interfacesthat are intuitive and transparent to the user.

Attention is now directed toward embodiments of portable devices withtouch-sensitive displays. FIG. 1A is a block diagram illustratingportable multifunction device 100 with touch-sensitive display system112 in accordance with some embodiments. Touch-sensitive display 112 issometimes called a “touch screen” for convenience and is sometimes knownas or called a “touch-sensitive display system.” Device 100 includesmemory 102 (which optionally includes one or more computer-readablestorage mediums), memory controller 122, one or more processing units(CPUs) 120, peripherals interface 118, RF circuitry 108, audio circuitry110, speaker 111, microphone 113, input/output (I/O) subsystem 106,other input control devices 116, and external port 124. Device 100optionally includes one or more optical sensors 164. Device 100optionally includes one or more contact intensity sensors 165 fordetecting intensity of contacts on device 100 (e.g., a touch-sensitivesurface such as touch-sensitive display system 112 of device 100).Device 100 optionally includes one or more tactile output generators 167for generating tactile outputs on device 100 (e.g., generating tactileoutputs on a touch-sensitive surface such as touch-sensitive displaysystem 112 of device 100 or touchpad 355 of device 300). Thesecomponents optionally communicate over one or more communication busesor signal lines 103.

As used in the specification and claims, the term “intensity” of acontact on a touch-sensitive surface refers to the force or pressure(force per unit area) of a contact (e.g., a finger contact) on thetouch-sensitive surface, or to a substitute (proxy) for the force orpressure of a contact on the touch-sensitive surface. The intensity of acontact has a range of values that includes at least four distinctvalues and more typically includes hundreds of distinct values (e.g., atleast 256). Intensity of a contact is, optionally, determined (ormeasured) using various approaches and various sensors or combinationsof sensors. For example, one or more force sensors underneath oradjacent to the touch-sensitive surface are, optionally, used to measureforce at various points on the touch-sensitive surface. In someimplementations, force measurements from multiple force sensors arecombined (e.g., a weighted average) to determine an estimated force of acontact. Similarly, a pressure-sensitive tip of a stylus is, optionally,used to determine a pressure of the stylus on the touch-sensitivesurface. Alternatively, the size of the contact area detected on thetouch-sensitive surface and/or changes thereto, the capacitance of thetouch-sensitive surface proximate to the contact and/or changes thereto,and/or the resistance of the touch-sensitive surface proximate to thecontact and/or changes thereto are, optionally, used as a substitute forthe force or pressure of the contact on the touch-sensitive surface. Insome implementations, the substitute measurements for contact force orpressure are used directly to determine whether an intensity thresholdhas been exceeded (e.g., the intensity threshold is described in unitscorresponding to the substitute measurements). In some implementations,the substitute measurements for contact force or pressure are convertedto an estimated force or pressure, and the estimated force or pressureis used to determine whether an intensity threshold has been exceeded(e.g., the intensity threshold is a pressure threshold measured in unitsof pressure). Using the intensity of a contact as an attribute of a userinput allows for user access to additional device functionality that mayotherwise not be accessible by the user on a reduced-size device withlimited real estate for displaying affordances (e.g., on atouch-sensitive display) and/or receiving user input (e.g., via atouch-sensitive display, a touch-sensitive surface, or aphysical/mechanical control such as a knob or a button).

As used in the specification and claims, the term “tactile output”refers to physical displacement of a device relative to a previousposition of the device, physical displacement of a component (e.g., atouch-sensitive surface) of a device relative to another component(e.g., housing) of the device, or displacement of the component relativeto a center of mass of the device that will be detected by a user withthe user's sense of touch. For example, in situations where the deviceor the component of the device is in contact with a surface of a userthat is sensitive to touch (e.g., a finger, palm, or other part of auser's hand), the tactile output generated by the physical displacementwill be interpreted by the user as a tactile sensation corresponding toa perceived change in physical characteristics of the device or thecomponent of the device. For example, movement of a touch-sensitivesurface (e.g., a touch-sensitive display or trackpad) is, optionally,interpreted by the user as a “down click” or “up click” of a physicalactuator button. In some cases, a user will feel a tactile sensationsuch as an “down click” or “up click” even when there is no movement ofa physical actuator button associated with the touch-sensitive surfacethat is physically pressed (e.g., displaced) by the user's movements. Asanother example, movement of the touch-sensitive surface is, optionally,interpreted or sensed by the user as “roughness” of the touch-sensitivesurface, even when there is no change in smoothness of thetouch-sensitive surface. While such interpretations of touch by a userwill be subject to the individualized sensory perceptions of the user,there are many sensory perceptions of touch that are common to a largemajority of users. Thus, when a tactile output is described ascorresponding to a particular sensory perception of a user (e.g., an “upclick,” a “down click,” “roughness”), unless otherwise stated, thegenerated tactile output corresponds to physical displacement of thedevice or a component thereof that will generate the described sensoryperception for a typical (or average) user.

It should be appreciated that device 100 is only one example of aportable multifunction device, and that device 100 optionally has moreor fewer components than shown, optionally combines two or morecomponents, or optionally has a different configuration or arrangementof the components. The various components shown in FIG. 1A areimplemented in hardware, software, or a combination of both hardware andsoftware, including one or more signal processing and/orapplication-specific integrated circuits.

Memory 102 optionally includes high-speed random access memory andoptionally also includes non-volatile memory, such as one or moremagnetic disk storage devices, flash memory devices, or othernon-volatile solid-state memory devices. Memory controller 122optionally controls access to memory 102 by other components of device100.

Peripherals interface 118 can be used to couple input and outputperipherals of the device to CPU 120 and memory 102. The one or moreprocessors 120 run or execute various software programs and/or sets ofinstructions stored in memory 102 to perform various functions fordevice 100 and to process data. In some embodiments, peripheralsinterface 118, CPU 120, and memory controller 122 are, optionally,implemented on a single chip, such as chip 104. In some otherembodiments, they are, optionally, implemented on separate chips.

RF (radio frequency) circuitry 108 receives and sends RF signals, alsocalled electromagnetic signals. RF circuitry 108 converts electricalsignals to/from electromagnetic signals and communicates withcommunications networks and other communications devices via theelectromagnetic signals. RF circuitry 108 optionally includes well-knowncircuitry for performing these functions, including but not limited toan antenna system, an RF transceiver, one or more amplifiers, a tuner,one or more oscillators, a digital signal processor, a CODEC chipset, asubscriber identity module (SIM) card, memory, and so forth. RFcircuitry 108 optionally communicates with networks, such as theInternet, also referred to as the World Wide Web (WWW), an intranetand/or a wireless network, such as a cellular telephone network, awireless local area network (LAN) and/or a metropolitan area network(MAN), and other devices by wireless communication. The RF circuitry 108optionally includes well-known circuitry for detecting near fieldcommunication (NFC) fields, such as by a short-range communicationradio. The wireless communication optionally uses any of a plurality ofcommunications standards, protocols, and technologies, including but notlimited to Global System for Mobile Communications (GSM), Enhanced DataGSM Environment (EDGE), high-speed downlink packet access (HSDPA),high-speed uplink packet access (HSUPA), Evolution, Data-Only (EV-DO),HSPA, HSPA+, Dual-Cell HSPA (DC-HSPDA), long term evolution (LTE), nearfield communication (NFC), wideband code division multiple access(W-CDMA), code division multiple access (CDMA), time division multipleaccess (TDMA), Bluetooth, Bluetooth Low Energy (BTLE), Wireless Fidelity(Wi-Fi) (e.g., IEEE 802.11a, IEEE 802.11b, IEEE 802.11g, IEEE 802.11n,and/or IEEE 802.11ac), voice over Internet Protocol (VoIP), Wi-MAX, aprotocol for e-mail (e.g., Internet message access protocol (IMAP)and/or post office protocol (POP)), instant messaging (e.g., extensiblemessaging and presence protocol (XMPP), Session Initiation Protocol forInstant Messaging and Presence Leveraging Extensions (SIMPLE), InstantMessaging and Presence Service (IMPS)), and/or Short Message Service(SMS), or any other suitable communication protocol, includingcommunication protocols not yet developed as of the filing date of thisdocument.

Audio circuitry 110, speaker 111, and microphone 113 provide an audiointerface between a user and device 100. Audio circuitry 110 receivesaudio data from peripherals interface 118, converts the audio data to anelectrical signal, and transmits the electrical signal to speaker 111.Speaker 111 converts the electrical signal to human-audible sound waves.Audio circuitry 110 also receives electrical signals converted bymicrophone 113 from sound waves. Audio circuitry 110 converts theelectrical signal to audio data and transmits the audio data toperipherals interface 118 for processing. Audio data is, optionally,retrieved from and/or transmitted to memory 102 and/or RF circuitry 108by peripherals interface 118. In some embodiments, audio circuitry 110also includes a headset jack (e.g., 212, FIG. 2). The headset jackprovides an interface between audio circuitry 110 and removable audioinput/output peripherals, such as output-only headphones or a headsetwith both output (e.g., a headphone for one or both ears) and input(e.g., a microphone).

I/O subsystem 106 couples input/output peripherals on device 100, suchas touch screen 112 and other input control devices 116, to peripheralsinterface 118. I/O subsystem 106 optionally includes display controller156, optical sensor controller 158, depth camera controller 169,intensity sensor controller 159, haptic feedback controller 161, and oneor more input controllers 160 for other input or control devices. Theone or more input controllers 160 receive/send electrical signalsfrom/to other input control devices 116. The other input control devices116 optionally include physical buttons (e.g., push buttons, rockerbuttons, etc.), dials, slider switches, joysticks, click wheels, and soforth. In some embodiments, input controller(s) 160 are, optionally,coupled to any (or none) of the following: a keyboard, an infrared port,a USB port, and a pointer device such as a mouse. The one or morebuttons (e.g., 208, FIG. 2) optionally include an up/down button forvolume control of speaker 111 and/or microphone 113. The one or morebuttons optionally include a push button (e.g., 206, FIG. 2). In someembodiments, the electronic device is a computer system that is incommunication (e.g., via wireless communication, via wiredcommunication) with one or more input devices. In some embodiments, theone or more input devices include a touch-sensitive surface (e.g., atrackpad, as part of a touch-sensitive display). In some embodiments,the one or more input devices include one or more camera sensors (e.g.,one or more optical sensors 164 and/or one or more depth camera sensors175), such as for tracking a user's gestures (e.g., hand gestures) asinput. In some embodiments, the one or more input devices are integratedwith the computer system. In some embodiments, the one or more inputdevices are separate from the computer system.

A quick press of the push button optionally disengages a lock of touchscreen 112 or optionally begins a process that uses gestures on thetouch screen to unlock the device, as described in U.S. patentapplication Ser. No. 11/322,549, “Unlocking a Device by PerformingGestures on an Unlock Image,” filed Dec. 23, 2005, U.S. Pat. No.7,657,849, which is hereby incorporated by reference in its entirety. Alonger press of the push button (e.g., 206) optionally turns power todevice 100 on or off. The functionality of one or more of the buttonsare, optionally, user-customizable. Touch screen 112 is used toimplement virtual or soft buttons and one or more soft keyboards.

Touch-sensitive display 112 provides an input interface and an outputinterface between the device and a user. Display controller 156 receivesand/or sends electrical signals from/to touch screen 112. Touch screen112 displays visual output to the user. The visual output optionallyincludes graphics, text, icons, video, and any combination thereof(collectively termed “graphics”). In some embodiments, some or all ofthe visual output optionally corresponds to user-interface objects.

Touch screen 112 has a touch-sensitive surface, sensor, or set ofsensors that accepts input from the user based on haptic and/or tactilecontact. Touch screen 112 and display controller 156 (along with anyassociated modules and/or sets of instructions in memory 102) detectcontact (and any movement or breaking of the contact) on touch screen112 and convert the detected contact into interaction withuser-interface objects (e.g., one or more soft keys, icons, web pages,or images) that are displayed on touch screen 112. In an exemplaryembodiment, a point of contact between touch screen 112 and the usercorresponds to a finger of the user.

Touch screen 112 optionally uses LCD (liquid crystal display)technology, LPD (light emitting polymer display) technology, or LED(light emitting diode) technology, although other display technologiesare used in other embodiments. Touch screen 112 and display controller156 optionally detect contact and any movement or breaking thereof usingany of a plurality of touch sensing technologies now known or laterdeveloped, including but not limited to capacitive, resistive, infrared,and surface acoustic wave technologies, as well as other proximitysensor arrays or other elements for determining one or more points ofcontact with touch screen 112. In an exemplary embodiment, projectedmutual capacitance sensing technology is used, such as that found in theiPhone® and iPod Touch® from Apple Inc. of Cupertino, Calif.

A touch-sensitive display in some embodiments of touch screen 112 is,optionally, analogous to the multi-touch sensitive touchpads describedin the following U.S. Pat. No. 6,323,846 (Westerman et al.), U.S. Pat.No. 6,570,557 (Westerman et al.), and/or U.S. Pat. No. 6,677,932(Westerman), and/or U.S. Patent Publication 2002/0015024A1, each ofwhich is hereby incorporated by reference in its entirety. However,touch screen 112 displays visual output from device 100, whereastouch-sensitive touchpads do not provide visual output.

A touch-sensitive display in some embodiments of touch screen 112 isdescribed in the following applications: (1) U.S. patent applicationSer. No. 11/381,313, “Multipoint Touch Surface Controller,” filed May 2,2006; (2) U.S. patent application Ser. No. 10/840,862, “MultipointTouchscreen,” filed May 6, 2004; (3) U.S. patent application Ser. No.10/903,964, “Gestures For Touch Sensitive Input Devices,” filed Jul. 30,2004; (4) U.S. patent application Ser. No. 11/048,264, “Gestures ForTouch Sensitive Input Devices,” filed Jan. 31, 2005; (5) U.S. patentapplication Ser. No. 11/038,590, “Mode-Based Graphical User InterfacesFor Touch Sensitive Input Devices,” filed Jan. 18, 2005; (6) U.S. patentapplication Ser. No. 11/228,758, “Virtual Input Device Placement On ATouch Screen User Interface,” filed Sep. 16, 2005; (7) U.S. patentapplication Ser. No. 11/228,700, “Operation Of A Computer With A TouchScreen Interface,” filed Sep. 16, 2005; (8) U.S. patent application Ser.No. 11/228,737, “Activating Virtual Keys Of A Touch-Screen VirtualKeyboard,” filed Sep. 16, 2005; and (9) U.S. patent application Ser. No.11/367,749, “Multi-Functional Hand-Held Device,” filed Mar. 3, 2006. Allof these applications are incorporated by reference herein in theirentirety.

Touch screen 112 optionally has a video resolution in excess of 100 dpi.In some embodiments, the touch screen has a video resolution ofapproximately 160 dpi. The user optionally makes contact with touchscreen 112 using any suitable object or appendage, such as a stylus, afinger, and so forth. In some embodiments, the user interface isdesigned to work primarily with finger-based contacts and gestures,which can be less precise than stylus-based input due to the larger areaof contact of a finger on the touch screen. In some embodiments, thedevice translates the rough finger-based input into a precisepointer/cursor position or command for performing the actions desired bythe user.

In some embodiments, in addition to the touch screen, device 100optionally includes a touchpad for activating or deactivating particularfunctions. In some embodiments, the touchpad is a touch-sensitive areaof the device that, unlike the touch screen, does not display visualoutput. The touchpad is, optionally, a touch-sensitive surface that isseparate from touch screen 112 or an extension of the touch-sensitivesurface formed by the touch screen.

Device 100 also includes power system 162 for powering the variouscomponents. Power system 162 optionally includes a power managementsystem, one or more power sources (e.g., battery, alternating current(AC)), a recharging system, a power failure detection circuit, a powerconverter or inverter, a power status indicator (e.g., a light-emittingdiode (LED)) and any other components associated with the generation,management and distribution of power in portable devices.

Device 100 optionally also includes one or more optical sensors 164.FIG. 1A shows an optical sensor coupled to optical sensor controller 158in I/O subsystem 106. Optical sensor 164 optionally includescharge-coupled device (CCD) or complementary metal-oxide semiconductor(CMOS) phototransistors. Optical sensor 164 receives light from theenvironment, projected through one or more lenses, and converts thelight to data representing an image. In conjunction with imaging module143 (also called a camera module), optical sensor 164 optionallycaptures still images or video. In some embodiments, an optical sensoris located on the back of device 100, opposite touch screen display 112on the front of the device so that the touch screen display is enabledfor use as a viewfinder for still and/or video image acquisition. Insome embodiments, an optical sensor is located on the front of thedevice so that the user's image is, optionally, obtained for videoconferencing while the user views the other video conferenceparticipants on the touch screen display. In some embodiments, theposition of optical sensor 164 can be changed by the user (e.g., byrotating the lens and the sensor in the device housing) so that a singleoptical sensor 164 is used along with the touch screen display for bothvideo conferencing and still and/or video image acquisition.

Device 100 optionally also includes one or more depth camera sensors175. FIG. 1A shows a depth camera sensor coupled to depth cameracontroller 169 in I/O subsystem 106. Depth camera sensor 175 receivesdata from the environment to create a three dimensional model of anobject (e.g., a face) within a scene from a viewpoint (e.g., a depthcamera sensor). In some embodiments, in conjunction with imaging module143 (also called a camera module), depth camera sensor 175 is optionallyused to determine a depth map of different portions of an image capturedby the imaging module 143. In some embodiments, a depth camera sensor islocated on the front of device 100 so that the user's image with depthinformation is, optionally, obtained for video conferencing while theuser views the other video conference participants on the touch screendisplay and to capture selfies with depth map data. In some embodiments,the depth camera sensor 175 is located on the back of device, or on theback and the front of the device 100. In some embodiments, the positionof depth camera sensor 175 can be changed by the user (e.g., by rotatingthe lens and the sensor in the device housing) so that a depth camerasensor 175 is used along with the touch screen display for both videoconferencing and still and/or video image acquisition.

In some embodiments, a depth map (e.g., depth map image) containsinformation (e.g., values) that relates to the distance of objects in ascene from a viewpoint (e.g., a camera, an optical sensor, a depthcamera sensor). In one embodiment of a depth map, each depth pixeldefines the position in the viewpoint's Z-axis where its correspondingtwo-dimensional pixel is located. In some embodiments, a depth map iscomposed of pixels wherein each pixel is defined by a value (e.g.,0-255). For example, the “0” value represents pixels that are located atthe most distant place in a “three dimensional” scene and the “255”value represents pixels that are located closest to a viewpoint (e.g., acamera, an optical sensor, a depth camera sensor) in the “threedimensional” scene. In other embodiments, a depth map represents thedistance between an object in a scene and the plane of the viewpoint. Insome embodiments, the depth map includes information about the relativedepth of various features of an object of interest in view of the depthcamera (e.g., the relative depth of eyes, nose, mouth, ears of a user'sface). In some embodiments, the depth map includes information thatenables the device to determine contours of the object of interest in az direction.

Device 100 optionally also includes one or more contact intensitysensors 165. FIG. 1A shows a contact intensity sensor coupled tointensity sensor controller 159 in I/O subsystem 106. Contact intensitysensor 165 optionally includes one or more piezoresistive strain gauges,capacitive force sensors, electric force sensors, piezoelectric forcesensors, optical force sensors, capacitive touch-sensitive surfaces, orother intensity sensors (e.g., sensors used to measure the force (orpressure) of a contact on a touch-sensitive surface). Contact intensitysensor 165 receives contact intensity information (e.g., pressureinformation or a proxy for pressure information) from the environment.In some embodiments, at least one contact intensity sensor is collocatedwith, or proximate to, a touch-sensitive surface (e.g., touch-sensitivedisplay system 112). In some embodiments, at least one contact intensitysensor is located on the back of device 100, opposite touch screendisplay 112, which is located on the front of device 100.

Device 100 optionally also includes one or more proximity sensors 166.FIG. 1A shows proximity sensor 166 coupled to peripherals interface 118.Alternately, proximity sensor 166 is, optionally, coupled to inputcontroller 160 in I/O subsystem 106. Proximity sensor 166 optionallyperforms as described in U.S. patent application Ser. No. 11/241,839,“Proximity Detector In Handheld Device”; Ser. No. 11/240,788, “ProximityDetector In Handheld Device”; Ser. No. 11/620,702, “Using Ambient LightSensor To Augment Proximity Sensor Output”; Ser. No. 11/586,862,“Automated Response To And Sensing Of User Activity In PortableDevices”; and Ser. No. 11/638,251, “Methods And Systems For AutomaticConfiguration Of Peripherals,” which are hereby incorporated byreference in their entirety. In some embodiments, the proximity sensorturns off and disables touch screen 112 when the multifunction device isplaced near the user's ear (e.g., when the user is making a phone call).

Device 100 optionally also includes one or more tactile outputgenerators 167. FIG. 1A shows a tactile output generator coupled tohaptic feedback controller 161 in I/O subsystem 106. Tactile outputgenerator 167 optionally includes one or more electroacoustic devicessuch as speakers or other audio components and/or electromechanicaldevices that convert energy into linear motion such as a motor,solenoid, electroactive polymer, piezoelectric actuator, electrostaticactuator, or other tactile output generating component (e.g., acomponent that converts electrical signals into tactile outputs on thedevice). Contact intensity sensor 165 receives tactile feedbackgeneration instructions from haptic feedback module 133 and generatestactile outputs on device 100 that are capable of being sensed by a userof device 100. In some embodiments, at least one tactile outputgenerator is collocated with, or proximate to, a touch-sensitive surface(e.g., touch-sensitive display system 112) and, optionally, generates atactile output by moving the touch-sensitive surface vertically (e.g.,in/out of a surface of device 100) or laterally (e.g., back and forth inthe same plane as a surface of device 100). In some embodiments, atleast one tactile output generator sensor is located on the back ofdevice 100, opposite touch screen display 112, which is located on thefront of device 100.

Device 100 optionally also includes one or more accelerometers 168. FIG.1A shows accelerometer 168 coupled to peripherals interface 118.Alternately, accelerometer 168 is, optionally, coupled to an inputcontroller 160 in I/O subsystem 106. Accelerometer 168 optionallyperforms as described in U.S. Patent Publication No. 20050190059,“Acceleration-based Theft Detection System for Portable ElectronicDevices,” and U.S. Patent Publication No. 20060017692, “Methods AndApparatuses For Operating A Portable Device Based On An Accelerometer,”both of which are incorporated by reference herein in their entirety. Insome embodiments, information is displayed on the touch screen displayin a portrait view or a landscape view based on an analysis of datareceived from the one or more accelerometers. Device 100 optionallyincludes, in addition to accelerometer(s) 168, a magnetometer and a GPS(or GLONASS or other global navigation system) receiver for obtaininginformation concerning the location and orientation (e.g., portrait orlandscape) of device 100.

In some embodiments, the software components stored in memory 102include operating system 126, communication module (or set ofinstructions) 128, contact/motion module (or set of instructions) 130,graphics module (or set of instructions) 132, text input module (or setof instructions) 134, Global Positioning System (GPS) module (or set ofinstructions) 135, and applications (or sets of instructions) 136.Furthermore, in some embodiments, memory 102 (FIG. 1A) or 370 (FIG. 3)stores device/global internal state 157, as shown in FIGS. 1A and 3.Device/global internal state 157 includes one or more of: activeapplication state, indicating which applications, if any, are currentlyactive; display state, indicating what applications, views or otherinformation occupy various regions of touch screen display 112; sensorstate, including information obtained from the device's various sensorsand input control devices 116; and location information concerning thedevice's location and/or attitude.

Operating system 126 (e.g., Darwin, RTXC, LINUX, UNIX, OS X, iOS,WINDOWS, or an embedded operating system such as VxWorks) includesvarious software components and/or drivers for controlling and managinggeneral system tasks (e.g., memory management, storage device control,power management, etc.) and facilitates communication between varioushardware and software components.

Communication module 128 facilitates communication with other devicesover one or more external ports 124 and also includes various softwarecomponents for handling data received by RF circuitry 108 and/orexternal port 124. External port 124 (e.g., Universal Serial Bus (USB),FIREWIRE, etc.) is adapted for coupling directly to other devices orindirectly over a network (e.g., the Internet, wireless LAN, etc.). Insome embodiments, the external port is a multi-pin (e.g., 30-pin)connector that is the same as, or similar to and/or compatible with, the30-pin connector used on iPod® (trademark of Apple Inc.) devices.

Contact/motion module 130 optionally detects contact with touch screen112 (in conjunction with display controller 156) and othertouch-sensitive devices (e.g., a touchpad or physical click wheel).Contact/motion module 130 includes various software components forperforming various operations related to detection of contact, such asdetermining if contact has occurred (e.g., detecting a finger-downevent), determining an intensity of the contact (e.g., the force orpressure of the contact or a substitute for the force or pressure of thecontact), determining if there is movement of the contact and trackingthe movement across the touch-sensitive surface (e.g., detecting one ormore finger-dragging events), and determining if the contact has ceased(e.g., detecting a finger-up event or a break in contact).Contact/motion module 130 receives contact data from the touch-sensitivesurface. Determining movement of the point of contact, which isrepresented by a series of contact data, optionally includes determiningspeed (magnitude), velocity (magnitude and direction), and/or anacceleration (a change in magnitude and/or direction) of the point ofcontact. These operations are, optionally, applied to single contacts(e.g., one finger contacts) or to multiple simultaneous contacts (e.g.,“multitouch”/multiple finger contacts). In some embodiments,contact/motion module 130 and display controller 156 detect contact on atouchpad.

In some embodiments, contact/motion module 130 uses a set of one or moreintensity thresholds to determine whether an operation has beenperformed by a user (e.g., to determine whether a user has “clicked” onan icon). In some embodiments, at least a subset of the intensitythresholds are determined in accordance with software parameters (e.g.,the intensity thresholds are not determined by the activation thresholdsof particular physical actuators and can be adjusted without changingthe physical hardware of device 100). For example, a mouse “click”threshold of a trackpad or touch screen display can be set to any of alarge range of predefined threshold values without changing the trackpador touch screen display hardware. Additionally, in some implementations,a user of the device is provided with software settings for adjustingone or more of the set of intensity thresholds (e.g., by adjustingindividual intensity thresholds and/or by adjusting a plurality ofintensity thresholds at once with a system-level click “intensity”parameter).

Contact/motion module 130 optionally detects a gesture input by a user.Different gestures on the touch-sensitive surface have different contactpatterns (e.g., different motions, timings, and/or intensities ofdetected contacts). Thus, a gesture is, optionally, detected bydetecting a particular contact pattern. For example, detecting a fingertap gesture includes detecting a finger-down event followed by detectinga finger-up (liftoff) event at the same position (or substantially thesame position) as the finger-down event (e.g., at the position of anicon). As another example, detecting a finger swipe gesture on thetouch-sensitive surface includes detecting a finger-down event followedby detecting one or more finger-dragging events, and subsequentlyfollowed by detecting a finger-up (liftoff) event.

Graphics module 132 includes various known software components forrendering and displaying graphics on touch screen 112 or other display,including components for changing the visual impact (e.g., brightness,transparency, saturation, contrast, or other visual property) ofgraphics that are displayed. As used herein, the term “graphics”includes any object that can be displayed to a user, including, withoutlimitation, text, web pages, icons (such as user-interface objectsincluding soft keys), digital images, videos, animations, and the like.

In some embodiments, graphics module 132 stores data representinggraphics to be used. Each graphic is, optionally, assigned acorresponding code. Graphics module 132 receives, from applicationsetc., one or more codes specifying graphics to be displayed along with,if necessary, coordinate data and other graphic property data, and thengenerates screen image data to output to display controller 156.

Haptic feedback module 133 includes various software components forgenerating instructions used by tactile output generator(s) 167 toproduce tactile outputs at one or more locations on device 100 inresponse to user interactions with device 100.

Text input module 134, which is, optionally, a component of graphicsmodule 132, provides soft keyboards for entering text in variousapplications (e.g., contacts 137, e-mail 140, IM 141, browser 147, andany other application that needs text input).

GPS module 135 determines the location of the device and provides thisinformation for use in various applications (e.g., to telephone 138 foruse in location-based dialing; to camera 143 as picture/video metadata;and to applications that provide location-based services such as weatherwidgets, local yellow page widgets, and map/navigation widgets).

Applications 136 optionally include the following modules (or sets ofinstructions), or a subset or superset thereof:

-   -   Contacts module 137 (sometimes called an address book or contact        list);    -   Telephone module 138;    -   Video conference module 139;    -   E-mail client module 140;    -   Instant messaging (IM) module 141;    -   Workout support module 142;    -   Camera module 143 for still and/or video images;    -   Image management module 144;    -   Video player module;    -   Music player module;    -   Browser module 147;    -   Calendar module 148;    -   Widget modules 149, which optionally include one or more of:        weather widget 149-1, stocks widget 149-2, calculator widget        149-3, alarm clock widget 149-4, dictionary widget 149-5, and        other widgets obtained by the user, as well as user-created        widgets 149-6;    -   Widget creator module 150 for making user-created widgets 149-6;    -   Search module 151;    -   Video and music player module 152, which merges video player        module and music player module;    -   Notes module 153;    -   Map module 154; and/or    -   Online video module 155.

Examples of other applications 136 that are, optionally, stored inmemory 102 include other word processing applications, other imageediting applications, drawing applications, presentation applications,JAVA-enabled applications, encryption, digital rights management, voicerecognition, and voice replication.

In conjunction with touch screen 112, display controller 156,contact/motion module 130, graphics module 132, and text input module134, contacts module 137 are, optionally, used to manage an address bookor contact list (e.g., stored in application internal state 192 ofcontacts module 137 in memory 102 or memory 370), including: addingname(s) to the address book; deleting name(s) from the address book;associating telephone number(s), e-mail address(es), physicaladdress(es) or other information with a name; associating an image witha name; categorizing and sorting names; providing telephone numbers ore-mail addresses to initiate and/or facilitate communications bytelephone 138, video conference module 139, e-mail 140, or IM 141; andso forth.

In conjunction with RF circuitry 108, audio circuitry 110, speaker 111,microphone 113, touch screen 112, display controller 156, contact/motionmodule 130, graphics module 132, and text input module 134, telephonemodule 138 are optionally, used to enter a sequence of characterscorresponding to a telephone number, access one or more telephonenumbers in contacts module 137, modify a telephone number that has beenentered, dial a respective telephone number, conduct a conversation, anddisconnect or hang up when the conversation is completed. As notedabove, the wireless communication optionally uses any of a plurality ofcommunications standards, protocols, and technologies.

In conjunction with RF circuitry 108, audio circuitry 110, speaker 111,microphone 113, touch screen 112, display controller 156, optical sensor164, optical sensor controller 158, contact/motion module 130, graphicsmodule 132, text input module 134, contacts module 137, and telephonemodule 138, video conference module 139 includes executable instructionsto initiate, conduct, and terminate a video conference between a userand one or more other participants in accordance with user instructions.

In conjunction with RF circuitry 108, touch screen 112, displaycontroller 156, contact/motion module 130, graphics module 132, and textinput module 134, e-mail client module 140 includes executableinstructions to create, send, receive, and manage e-mail in response touser instructions. In conjunction with image management module 144,e-mail client module 140 makes it very easy to create and send e-mailswith still or video images taken with camera module 143.

In conjunction with RF circuitry 108, touch screen 112, displaycontroller 156, contact/motion module 130, graphics module 132, and textinput module 134, the instant messaging module 141 includes executableinstructions to enter a sequence of characters corresponding to aninstant message, to modify previously entered characters, to transmit arespective instant message (for example, using a Short Message Service(SMS) or Multimedia Message Service (MMS) protocol for telephony-basedinstant messages or using XMPP, SIMPLE, or IMPS for Internet-basedinstant messages), to receive instant messages, and to view receivedinstant messages. In some embodiments, transmitted and/or receivedinstant messages optionally include graphics, photos, audio files, videofiles and/or other attachments as are supported in an MMS and/or anEnhanced Messaging Service (EMS). As used herein, “instant messaging”refers to both telephony-based messages (e.g., messages sent using SMSor MMS) and Internet-based messages (e.g., messages sent using XMPP,SIMPLE, or IMPS).

In conjunction with RF circuitry 108, touch screen 112, displaycontroller 156, contact/motion module 130, graphics module 132, textinput module 134, GPS module 135, map module 154, and music playermodule, workout support module 142 includes executable instructions tocreate workouts (e.g., with time, distance, and/or calorie burninggoals); communicate with workout sensors (sports devices); receiveworkout sensor data; calibrate sensors used to monitor a workout; selectand play music for a workout; and display, store, and transmit workoutdata.

In conjunction with touch screen 112, display controller 156, opticalsensor(s) 164, optical sensor controller 158, contact/motion module 130,graphics module 132, and image management module 144, camera module 143includes executable instructions to capture still images or video(including a video stream) and store them into memory 102, modifycharacteristics of a still image or video, or delete a still image orvideo from memory 102.

In conjunction with touch screen 112, display controller 156,contact/motion module 130, graphics module 132, text input module 134,and camera module 143, image management module 144 includes executableinstructions to arrange, modify (e.g., edit), or otherwise manipulate,label, delete, present (e.g., in a digital slide show or album), andstore still and/or video images.

In conjunction with RF circuitry 108, touch screen 112, displaycontroller 156, contact/motion module 130, graphics module 132, and textinput module 134, browser module 147 includes executable instructions tobrowse the Internet in accordance with user instructions, includingsearching, linking to, receiving, and displaying web pages or portionsthereof, as well as attachments and other files linked to web pages.

In conjunction with RF circuitry 108, touch screen 112, displaycontroller 156, contact/motion module 130, graphics module 132, textinput module 134, e-mail client module 140, and browser module 147,calendar module 148 includes executable instructions to create, display,modify, and store calendars and data associated with calendars (e.g.,calendar entries, to-do lists, etc.) in accordance with userinstructions.

In conjunction with RF circuitry 108, touch screen 112, displaycontroller 156, contact/motion module 130, graphics module 132, textinput module 134, and browser module 147, widget modules 149 aremini-applications that are, optionally, downloaded and used by a user(e.g., weather widget 149-1, stocks widget 149-2, calculator widget149-3, alarm clock widget 149-4, and dictionary widget 149-5) or createdby the user (e.g., user-created widget 149-6). In some embodiments, awidget includes an HTML (Hypertext Markup Language) file, a CSS(Cascading Style Sheets) file, and a JavaScript file. In someembodiments, a widget includes an XML (Extensible Markup Language) fileand a JavaScript file (e.g., Yahoo! Widgets).

In conjunction with RF circuitry 108, touch screen 112, displaycontroller 156, contact/motion module 130, graphics module 132, textinput module 134, and browser module 147, the widget creator module 150are, optionally, used by a user to create widgets (e.g., turning auser-specified portion of a web page into a widget).

In conjunction with touch screen 112, display controller 156,contact/motion module 130, graphics module 132, and text input module134, search module 151 includes executable instructions to search fortext, music, sound, image, video, and/or other files in memory 102 thatmatch one or more search criteria (e.g., one or more user-specifiedsearch terms) in accordance with user instructions.

In conjunction with touch screen 112, display controller 156,contact/motion module 130, graphics module 132, audio circuitry 110,speaker 111, RF circuitry 108, and browser module 147, video and musicplayer module 152 includes executable instructions that allow the userto download and play back recorded music and other sound files stored inone or more file formats, such as MP3 or AAC files, and executableinstructions to display, present, or otherwise play back videos (e.g.,on touch screen 112 or on an external, connected display via externalport 124). In some embodiments, device 100 optionally includes thefunctionality of an MP3 player, such as an iPod (trademark of AppleInc.).

In conjunction with touch screen 112, display controller 156,contact/motion module 130, graphics module 132, and text input module134, notes module 153 includes executable instructions to create andmanage notes, to-do lists, and the like in accordance with userinstructions.

In conjunction with RF circuitry 108, touch screen 112, displaycontroller 156, contact/motion module 130, graphics module 132, textinput module 134, GPS module 135, and browser module 147, map module 154are, optionally, used to receive, display, modify, and store maps anddata associated with maps (e.g., driving directions, data on stores andother points of interest at or near a particular location, and otherlocation-based data) in accordance with user instructions.

In conjunction with touch screen 112, display controller 156,contact/motion module 130, graphics module 132, audio circuitry 110,speaker 111, RF circuitry 108, text input module 134, e-mail clientmodule 140, and browser module 147, online video module 155 includesinstructions that allow the user to access, browse, receive (e.g., bystreaming and/or download), play back (e.g., on the touch screen or onan external, connected display via external port 124), send an e-mailwith a link to a particular online video, and otherwise manage onlinevideos in one or more file formats, such as H.264. In some embodiments,instant messaging module 141, rather than e-mail client module 140, isused to send a link to a particular online video. Additional descriptionof the online video application can be found in U.S. Provisional PatentApplication No. 60/936,562, “Portable Multifunction Device, Method, andGraphical User Interface for Playing Online Videos,” filed Jun. 20,2007, and U.S. patent application Ser. No. 11/968,067, “PortableMultifunction Device, Method, and Graphical User Interface for PlayingOnline Videos,” filed Dec. 31, 2007, the contents of which are herebyincorporated by reference in their entirety.

Each of the above-identified modules and applications corresponds to aset of executable instructions for performing one or more functionsdescribed above and the methods described in this application (e.g., thecomputer-implemented methods and other information processing methodsdescribed herein). These modules (e.g., sets of instructions) need notbe implemented as separate software programs, procedures, or modules,and thus various subsets of these modules are, optionally, combined orotherwise rearranged in various embodiments. For example, video playermodule is, optionally, combined with music player module into a singlemodule (e.g., video and music player module 152, FIG. 1A). In someembodiments, memory 102 optionally stores a subset of the modules anddata structures identified above. Furthermore, memory 102 optionallystores additional modules and data structures not described above.

In some embodiments, device 100 is a device where operation of apredefined set of functions on the device is performed exclusivelythrough a touch screen and/or a touchpad. By using a touch screen and/ora touchpad as the primary input control device for operation of device100, the number of physical input control devices (such as push buttons,dials, and the like) on device 100 is, optionally, reduced.

The predefined set of functions that are performed exclusively through atouch screen and/or a touchpad optionally include navigation betweenuser interfaces. In some embodiments, the touchpad, when touched by theuser, navigates device 100 to a main, home, or root menu from any userinterface that is displayed on device 100. In such embodiments, a “menubutton” is implemented using a touchpad. In some other embodiments, themenu button is a physical push button or other physical input controldevice instead of a touchpad.

FIG. 1B is a block diagram illustrating exemplary components for eventhandling in accordance with some embodiments. In some embodiments,memory 102 (FIG. 1A) or 370 (FIG. 3) includes event sorter 170 (e.g., inoperating system 126) and a respective application 136-1 (e.g., any ofthe aforementioned applications 137-151, 155, 380-390).

Event sorter 170 receives event information and determines theapplication 136-1 and application view 191 of application 136-1 to whichto deliver the event information. Event sorter 170 includes eventmonitor 171 and event dispatcher module 174. In some embodiments,application 136-1 includes application internal state 192, whichindicates the current application view(s) displayed on touch-sensitivedisplay 112 when the application is active or executing. In someembodiments, device/global internal state 157 is used by event sorter170 to determine which application(s) is (are) currently active, andapplication internal state 192 is used by event sorter 170 to determineapplication views 191 to which to deliver event information.

In some embodiments, application internal state 192 includes additionalinformation, such as one or more of: resume information to be used whenapplication 136-1 resumes execution, user interface state informationthat indicates information being displayed or that is ready for displayby application 136-1, a state queue for enabling the user to go back toa prior state or view of application 136-1, and a redo/undo queue ofprevious actions taken by the user.

Event monitor 171 receives event information from peripherals interface118. Event information includes information about a sub-event (e.g., auser touch on touch-sensitive display 112, as part of a multi-touchgesture). Peripherals interface 118 transmits information it receivesfrom I/O subsystem 106 or a sensor, such as proximity sensor 166,accelerometer(s) 168, and/or microphone 113 (through audio circuitry110). Information that peripherals interface 118 receives from I/Osubsystem 106 includes information from touch-sensitive display 112 or atouch-sensitive surface.

In some embodiments, event monitor 171 sends requests to the peripheralsinterface 118 at predetermined intervals. In response, peripheralsinterface 118 transmits event information. In other embodiments,peripherals interface 118 transmits event information only when there isa significant event (e.g., receiving an input above a predeterminednoise threshold and/or for more than a predetermined duration).

In some embodiments, event sorter 170 also includes a hit viewdetermination module 172 and/or an active event recognizer determinationmodule 173.

Hit view determination module 172 provides software procedures fordetermining where a sub-event has taken place within one or more viewswhen touch-sensitive display 112 displays more than one view. Views aremade up of controls and other elements that a user can see on thedisplay.

Another aspect of the user interface associated with an application is aset of views, sometimes herein called application views or userinterface windows, in which information is displayed and touch-basedgestures occur. The application views (of a respective application) inwhich a touch is detected optionally correspond to programmatic levelswithin a programmatic or view hierarchy of the application. For example,the lowest level view in which a touch is detected is, optionally,called the hit view, and the set of events that are recognized as properinputs are, optionally, determined based, at least in part, on the hitview of the initial touch that begins a touch-based gesture.

Hit view determination module 172 receives information related tosub-events of a touch-based gesture. When an application has multipleviews organized in a hierarchy, hit view determination module 172identifies a hit view as the lowest view in the hierarchy which shouldhandle the sub-event. In most circumstances, the hit view is the lowestlevel view in which an initiating sub-event occurs (e.g., the firstsub-event in the sequence of sub-events that form an event or potentialevent). Once the hit view is identified by the hit view determinationmodule 172, the hit view typically receives all sub-events related tothe same touch or input source for which it was identified as the hitview.

Active event recognizer determination module 173 determines which viewor views within a view hierarchy should receive a particular sequence ofsub-events. In some embodiments, active event recognizer determinationmodule 173 determines that only the hit view should receive a particularsequence of sub-events. In other embodiments, active event recognizerdetermination module 173 determines that all views that include thephysical location of a sub-event are actively involved views, andtherefore determines that all actively involved views should receive aparticular sequence of sub-events. In other embodiments, even if touchsub-events were entirely confined to the area associated with oneparticular view, views higher in the hierarchy would still remain asactively involved views.

Event dispatcher module 174 dispatches the event information to an eventrecognizer (e.g., event recognizer 180). In embodiments including activeevent recognizer determination module 173, event dispatcher module 174delivers the event information to an event recognizer determined byactive event recognizer determination module 173. In some embodiments,event dispatcher module 174 stores in an event queue the eventinformation, which is retrieved by a respective event receiver 182.

In some embodiments, operating system 126 includes event sorter 170.Alternatively, application 136-1 includes event sorter 170. In yet otherembodiments, event sorter 170 is a stand-alone module, or a part ofanother module stored in memory 102, such as contact/motion module 130.

In some embodiments, application 136-1 includes a plurality of eventhandlers 190 and one or more application views 191, each of whichincludes instructions for handling touch events that occur within arespective view of the application's user interface. Each applicationview 191 of the application 136-1 includes one or more event recognizers180. Typically, a respective application view 191 includes a pluralityof event recognizers 180. In other embodiments, one or more of eventrecognizers 180 are part of a separate module, such as a user interfacekit or a higher level object from which application 136-1 inheritsmethods and other properties. In some embodiments, a respective eventhandler 190 includes one or more of: data updater 176, object updater177, GUI updater 178, and/or event data 179 received from event sorter170. Event handler 190 optionally utilizes or calls data updater 176,object updater 177, or GUI updater 178 to update the applicationinternal state 192. Alternatively, one or more of the application views191 include one or more respective event handlers 190. Also, in someembodiments, one or more of data updater 176, object updater 177, andGUI updater 178 are included in a respective application view 191.

A respective event recognizer 180 receives event information (e.g.,event data 179) from event sorter 170 and identifies an event from theevent information. Event recognizer 180 includes event receiver 182 andevent comparator 184. In some embodiments, event recognizer 180 alsoincludes at least a subset of: metadata 183, and event deliveryinstructions 188 (which optionally include sub-event deliveryinstructions).

Event receiver 182 receives event information from event sorter 170. Theevent information includes information about a sub-event, for example, atouch or a touch movement. Depending on the sub-event, the eventinformation also includes additional information, such as location ofthe sub-event. When the sub-event concerns motion of a touch, the eventinformation optionally also includes speed and direction of thesub-event. In some embodiments, events include rotation of the devicefrom one orientation to another (e.g., from a portrait orientation to alandscape orientation, or vice versa), and the event informationincludes corresponding information about the current orientation (alsocalled device attitude) of the device.

Event comparator 184 compares the event information to predefined eventor sub-event definitions and, based on the comparison, determines anevent or sub-event, or determines or updates the state of an event orsub-event. In some embodiments, event comparator 184 includes eventdefinitions 186. Event definitions 186 contain definitions of events(e.g., predefined sequences of sub-events), for example, event 1(187-1), event 2 (187-2), and others. In some embodiments, sub-events inan event (187) include, for example, touch begin, touch end, touchmovement, touch cancellation, and multiple touching. In one example, thedefinition for event 1 (187-1) is a double tap on a displayed object.The double tap, for example, comprises a first touch (touch begin) onthe displayed object for a predetermined phase, a first liftoff (touchend) for a predetermined phase, a second touch (touch begin) on thedisplayed object for a predetermined phase, and a second liftoff (touchend) for a predetermined phase. In another example, the definition forevent 2 (187-2) is a dragging on a displayed object. The dragging, forexample, comprises a touch (or contact) on the displayed object for apredetermined phase, a movement of the touch across touch-sensitivedisplay 112, and liftoff of the touch (touch end). In some embodiments,the event also includes information for one or more associated eventhandlers 190.

In some embodiments, event definition 187 includes a definition of anevent for a respective user-interface object. In some embodiments, eventcomparator 184 performs a hit test to determine which user-interfaceobject is associated with a sub-event. For example, in an applicationview in which three user-interface objects are displayed ontouch-sensitive display 112, when a touch is detected on touch-sensitivedisplay 112, event comparator 184 performs a hit test to determine whichof the three user-interface objects is associated with the touch(sub-event). If each displayed object is associated with a respectiveevent handler 190, the event comparator uses the result of the hit testto determine which event handler 190 should be activated. For example,event comparator 184 selects an event handler associated with thesub-event and the object triggering the hit test.

In some embodiments, the definition for a respective event (187) alsoincludes delayed actions that delay delivery of the event informationuntil after it has been determined whether the sequence of sub-eventsdoes or does not correspond to the event recognizer's event type.

When a respective event recognizer 180 determines that the series ofsub-events do not match any of the events in event definitions 186, therespective event recognizer 180 enters an event impossible, eventfailed, or event ended state, after which it disregards subsequentsub-events of the touch-based gesture. In this situation, other eventrecognizers, if any, that remain active for the hit view continue totrack and process sub-events of an ongoing touch-based gesture.

In some embodiments, a respective event recognizer 180 includes metadata183 with configurable properties, flags, and/or lists that indicate howthe event delivery system should perform sub-event delivery to activelyinvolved event recognizers. In some embodiments, metadata 183 includesconfigurable properties, flags, and/or lists that indicate how eventrecognizers interact, or are enabled to interact, with one another. Insome embodiments, metadata 183 includes configurable properties, flags,and/or lists that indicate whether sub-events are delivered to varyinglevels in the view or programmatic hierarchy.

In some embodiments, a respective event recognizer 180 activates eventhandler 190 associated with an event when one or more particularsub-events of an event are recognized. In some embodiments, a respectiveevent recognizer 180 delivers event information associated with theevent to event handler 190. Activating an event handler 190 is distinctfrom sending (and deferred sending) sub-events to a respective hit view.In some embodiments, event recognizer 180 throws a flag associated withthe recognized event, and event handler 190 associated with the flagcatches the flag and performs a predefined process.

In some embodiments, event delivery instructions 188 include sub-eventdelivery instructions that deliver event information about a sub-eventwithout activating an event handler. Instead, the sub-event deliveryinstructions deliver event information to event handlers associated withthe series of sub-events or to actively involved views. Event handlersassociated with the series of sub-events or with actively involved viewsreceive the event information and perform a predetermined process.

In some embodiments, data updater 176 creates and updates data used inapplication 136-1. For example, data updater 176 updates the telephonenumber used in contacts module 137, or stores a video file used in videoplayer module. In some embodiments, object updater 177 creates andupdates objects used in application 136-1. For example, object updater177 creates a new user-interface object or updates the position of auser-interface object. GUI updater 178 updates the GUI. For example, GUIupdater 178 prepares display information and sends it to graphics module132 for display on a touch-sensitive display.

In some embodiments, event handler(s) 190 includes or has access to dataupdater 176, object updater 177, and GUI updater 178. In someembodiments, data updater 176, object updater 177, and GUI updater 178are included in a single module of a respective application 136-1 orapplication view 191. In other embodiments, they are included in two ormore software modules.

It shall be understood that the foregoing discussion regarding eventhandling of user touches on touch-sensitive displays also applies toother forms of user inputs to operate multifunction devices 100 withinput devices, not all of which are initiated on touch screens. Forexample, mouse movement and mouse button presses, optionally coordinatedwith single or multiple keyboard presses or holds; contact movementssuch as taps, drags, scrolls, etc. on touchpads; pen stylus inputs;movement of the device; oral instructions; detected eye movements;biometric inputs; and/or any combination thereof are optionally utilizedas inputs corresponding to sub-events which define an event to berecognized.

FIG. 2 illustrates a portable multifunction device 100 having a touchscreen 112 in accordance with some embodiments. The touch screenoptionally displays one or more graphics within user interface (UI) 200.In this embodiment, as well as others described below, a user is enabledto select one or more of the graphics by making a gesture on thegraphics, for example, with one or more fingers 202 (not drawn to scalein the figure) or one or more styluses 203 (not drawn to scale in thefigure). In some embodiments, selection of one or more graphics occurswhen the user breaks contact with the one or more graphics. In someembodiments, the gesture optionally includes one or more taps, one ormore swipes (from left to right, right to left, upward and/or downward),and/or a rolling of a finger (from right to left, left to right, upwardand/or downward) that has made contact with device 100. In someimplementations or circumstances, inadvertent contact with a graphicdoes not select the graphic. For example, a swipe gesture that sweepsover an application icon optionally does not select the correspondingapplication when the gesture corresponding to selection is a tap.

Device 100 optionally also include one or more physical buttons, such as“home” or menu button 204. As described previously, menu button 204 is,optionally, used to navigate to any application 136 in a set ofapplications that are, optionally, executed on device 100.Alternatively, in some embodiments, the menu button is implemented as asoft key in a GUI displayed on touch screen 112.

In some embodiments, device 100 includes touch screen 112, menu button204, push button 206 for powering the device on/off and locking thedevice, volume adjustment button(s) 208, subscriber identity module(SIM) card slot 210, headset jack 212, and docking/charging externalport 124. Push button 206 is, optionally, used to turn the power on/offon the device by depressing the button and holding the button in thedepressed state for a predefined time interval; to lock the device bydepressing the button and releasing the button before the predefinedtime interval has elapsed; and/or to unlock the device or initiate anunlock process. In an alternative embodiment, device 100 also acceptsverbal input for activation or deactivation of some functions throughmicrophone 113. Device 100 also, optionally, includes one or morecontact intensity sensors 165 for detecting intensity of contacts ontouch screen 112 and/or one or more tactile output generators 167 forgenerating tactile outputs for a user of device 100.

FIG. 3 is a block diagram of an exemplary multifunction device with adisplay and a touch-sensitive surface in accordance with someembodiments. Device 300 need not be portable. In some embodiments,device 300 is a laptop computer, a desktop computer, a tablet computer,a multimedia player device, a navigation device, an educational device(such as a child's learning toy), a gaming system, or a control device(e.g., a home or industrial controller). Device 300 typically includesone or more processing units (CPUs) 310, one or more network or othercommunications interfaces 360, memory 370, and one or more communicationbuses 320 for interconnecting these components. Communication buses 320optionally include circuitry (sometimes called a chipset) thatinterconnects and controls communications between system components.Device 300 includes input/output (I/O) interface 330 comprising display340, which is typically a touch screen display. I/O interface 330 alsooptionally includes a keyboard and/or mouse (or other pointing device)350 and touchpad 355, tactile output generator 357 for generatingtactile outputs on device 300 (e.g., similar to tactile outputgenerator(s) 167 described above with reference to FIG. 1A), sensors 359(e.g., optical, acceleration, proximity, touch-sensitive, and/or contactintensity sensors similar to contact intensity sensor(s) 165 describedabove with reference to FIG. 1A). Memory 370 includes high-speed randomaccess memory, such as DRAM, SRAM, DDR RAM, or other random access solidstate memory devices; and optionally includes non-volatile memory, suchas one or more magnetic disk storage devices, optical disk storagedevices, flash memory devices, or other non-volatile solid state storagedevices. Memory 370 optionally includes one or more storage devicesremotely located from CPU(s) 310. In some embodiments, memory 370 storesprograms, modules, and data structures analogous to the programs,modules, and data structures stored in memory 102 of portablemultifunction device 100 (FIG. 1A), or a subset thereof. Furthermore,memory 370 optionally stores additional programs, modules, and datastructures not present in memory 102 of portable multifunction device100. For example, memory 370 of device 300 optionally stores drawingmodule 380, presentation module 382, word processing module 384, websitecreation module 386, disk authoring module 388, and/or spreadsheetmodule 390, while memory 102 of portable multifunction device 100 (FIG.1A) optionally does not store these modules.

Each of the above-identified elements in FIG. 3 is, optionally, storedin one or more of the previously mentioned memory devices. Each of theabove-identified modules corresponds to a set of instructions forperforming a function described above. The above-identified modules orprograms (e.g., sets of instructions) need not be implemented asseparate software programs, procedures, or modules, and thus varioussubsets of these modules are, optionally, combined or otherwiserearranged in various embodiments. In some embodiments, memory 370optionally stores a subset of the modules and data structures identifiedabove. Furthermore, memory 370 optionally stores additional modules anddata structures not described above.

Attention is now directed towards embodiments of user interfaces thatare, optionally, implemented on, for example, portable multifunctiondevice 100.

FIG. 4A illustrates an exemplary user interface for a menu ofapplications on portable multifunction device 100 in accordance withsome embodiments. Similar user interfaces are, optionally, implementedon device 300. In some embodiments, user interface 400 includes thefollowing elements, or a subset or superset thereof:

-   -   Signal strength indicator(s) 402 for wireless communication(s),        such as cellular and Wi-Fi signals;    -   Time 404;    -   Bluetooth indicator 405;    -   Battery status indicator 406;    -   Tray 408 with icons for frequently used applications, such as:        -   Icon 416 for telephone module 138, labeled “Phone,” which            optionally includes an indicator 414 of the number of missed            calls or voicemail messages;        -   Icon 418 for e-mail client module 140, labeled “Mail,” which            optionally includes an indicator 410 of the number of unread            e-mails;        -   Icon 420 for browser module 147, labeled “Browser;” and        -   Icon 422 for video and music player module 152, also            referred to as iPod (trademark of Apple Inc.) module 152,            labeled “iPod;” and    -   Icons for other applications, such as:        -   Icon 424 for IM module 141, labeled “Messages;”        -   Icon 426 for calendar module 148, labeled “Calendar;”        -   Icon 428 for image management module 144, labeled “Photos;”        -   Icon 430 for camera module 143, labeled “Camera;”        -   Icon 432 for online video module 155, labeled “Online            Video;”        -   Icon 434 for stocks widget 149-2, labeled “Stocks;”        -   Icon 436 for map module 154, labeled “Maps;”        -   Icon 438 for weather widget 149-1, labeled “Weather;”        -   Icon 440 for alarm clock widget 149-4, labeled “Clock;”        -   Icon 442 for workout support module 142, labeled “Workout            Support;”        -   Icon 444 for notes module 153, labeled “Notes;” and        -   Icon 446 for a settings application or module, labeled            “Settings,” which provides access to settings for device 100            and its various applications 136.

It should be noted that the icon labels illustrated in FIG. 4A aremerely exemplary. For example, icon 422 for video and music playermodule 152 is labeled “Music” or “Music Player.” Other labels are,optionally, used for various application icons. In some embodiments, alabel for a respective application icon includes a name of anapplication corresponding to the respective application icon. In someembodiments, a label for a particular application icon is distinct froma name of an application corresponding to the particular applicationicon.

FIG. 4B illustrates an exemplary user interface on a device (e.g.,device 300, FIG. 3) with a touch-sensitive surface 451 (e.g., a tabletor touchpad 355, FIG. 3) that is separate from the display 450 (e.g.,touch screen display 112). Device 300 also, optionally, includes one ormore contact intensity sensors (e.g., one or more of sensors 359) fordetecting intensity of contacts on touch-sensitive surface 451 and/orone or more tactile output generators 357 for generating tactile outputsfor a user of device 300.

Although some of the examples that follow will be given with referenceto inputs on touch screen display 112 (where the touch-sensitive surfaceand the display are combined), in some embodiments, the device detectsinputs on a touch-sensitive surface that is separate from the display,as shown in FIG. 4B. In some embodiments, the touch-sensitive surface(e.g., 451 in FIG. 4B) has a primary axis (e.g., 452 in FIG. 4B) thatcorresponds to a primary axis (e.g., 453 in FIG. 4B) on the display(e.g., 450). In accordance with these embodiments, the device detectscontacts (e.g., 460 and 462 in FIG. 4B) with the touch-sensitive surface451 at locations that correspond to respective locations on the display(e.g., in FIG. 4B, 460 corresponds to 468 and 462 corresponds to 470).In this way, user inputs (e.g., contacts 460 and 462, and movementsthereof) detected by the device on the touch-sensitive surface (e.g.,451 in FIG. 4B) are used by the device to manipulate the user interfaceon the display (e.g., 450 in FIG. 4B) of the multifunction device whenthe touch-sensitive surface is separate from the display. It should beunderstood that similar methods are, optionally, used for other userinterfaces described herein.

Additionally, while the following examples are given primarily withreference to finger inputs (e.g., finger contacts, finger tap gestures,finger swipe gestures), it should be understood that, in someembodiments, one or more of the finger inputs are replaced with inputfrom another input device (e.g., a mouse-based input or stylus input).For example, a swipe gesture is, optionally, replaced with a mouse click(e.g., instead of a contact) followed by movement of the cursor alongthe path of the swipe (e.g., instead of movement of the contact). Asanother example, a tap gesture is, optionally, replaced with a mouseclick while the cursor is located over the location of the tap gesture(e.g., instead of detection of the contact followed by ceasing to detectthe contact). Similarly, when multiple user inputs are simultaneouslydetected, it should be understood that multiple computer mice are,optionally, used simultaneously, or a mouse and finger contacts are,optionally, used simultaneously.

FIG. 5A illustrates exemplary personal electronic device 500. Device 500includes body 502. In some embodiments, device 500 can include some orall of the features described with respect to devices 100 and 300 (e.g.,FIGS. 1A-4B). In some embodiments, device 500 has touch-sensitivedisplay screen 504, hereafter touch screen 504. Alternatively, or inaddition to touch screen 504, device 500 has a display and atouch-sensitive surface. As with devices 100 and 300, in someembodiments, touch screen 504 (or the touch-sensitive surface)optionally includes one or more intensity sensors for detectingintensity of contacts (e.g., touches) being applied. The one or moreintensity sensors of touch screen 504 (or the touch-sensitive surface)can provide output data that represents the intensity of touches. Theuser interface of device 500 can respond to touches based on theirintensity, meaning that touches of different intensities can invokedifferent user interface operations on device 500.

Exemplary techniques for detecting and processing touch intensity arefound, for example, in related applications: International PatentApplication Serial No. PCT/US2013/040061, titled “Device, Method, andGraphical User Interface for Displaying User Interface ObjectsCorresponding to an Application,” filed May 8, 2013, published as WIPOPublication No. WO/2013/169849, and International Patent ApplicationSerial No. PCT/US2013/069483, titled “Device, Method, and Graphical UserInterface for Transitioning Between Touch Input to Display OutputRelationships,” filed Nov. 11, 2013, published as WIPO Publication No.WO/2014/105276, each of which is hereby incorporated by reference intheir entirety.

In some embodiments, device 500 has one or more input mechanisms 506 and508. Input mechanisms 506 and 508, if included, can be physical.Examples of physical input mechanisms include push buttons and rotatablemechanisms. In some embodiments, device 500 has one or more attachmentmechanisms. Such attachment mechanisms, if included, can permitattachment of device 500 with, for example, hats, eyewear, earrings,necklaces, shirts, jackets, bracelets, watch straps, chains, trousers,belts, shoes, purses, backpacks, and so forth. These attachmentmechanisms permit device 500 to be worn by a user.

FIG. 5B depicts exemplary personal electronic device 500. In someembodiments, device 500 can include some or all of the componentsdescribed with respect to FIGS. 1A, 1B, and 3. Device 500 has bus 512that operatively couples I/O section 514 with one or more computerprocessors 516 and memory 518. I/O section 514 can be connected todisplay 504, which can have touch-sensitive component 522 and,optionally, intensity sensor 524 (e.g., contact intensity sensor). Inaddition, I/O section 514 can be connected with communication unit 530for receiving application and operating system data, using Wi-Fi,Bluetooth, near field communication (NFC), cellular, and/or otherwireless communication techniques. Device 500 can include inputmechanisms 506 and/or 508. Input mechanism 506 is, optionally, arotatable input device or a depressible and rotatable input device, forexample. Input mechanism 508 is, optionally, a button, in some examples.

Input mechanism 508 is, optionally, a microphone, in some examples.Personal electronic device 500 optionally includes various sensors, suchas GPS sensor 532, accelerometer 534, directional sensor 540 (e.g.,compass), gyroscope 536, motion sensor 538, and/or a combinationthereof, all of which can be operatively connected to I/O section 514.

Memory 518 of personal electronic device 500 can include one or morenon-transitory computer-readable storage mediums, for storingcomputer-executable instructions, which, when executed by one or morecomputer processors 516, for example, can cause the computer processorsto perform the techniques described below, including processes 700, 900,and 1100 (FIGS. 7, 9, and 11). A computer-readable storage medium can beany medium that can tangibly contain or store computer-executableinstructions for use by or in connection with the instruction executionsystem, apparatus, or device. In some examples, the storage medium is atransitory computer-readable storage medium. In some examples, thestorage medium is a non-transitory computer-readable storage medium. Thenon-transitory computer-readable storage medium can include, but is notlimited to, magnetic, optical, and/or semiconductor storages. Examplesof such storage include magnetic disks, optical discs based on CD, DVD,or Blu-ray technologies, as well as persistent solid-state memory suchas flash, solid-state drives, and the like. Personal electronic device500 is not limited to the components and configuration of FIG. 5B, butcan include other or additional components in multiple configurations.

As used here, the term “affordance” refers to a user-interactivegraphical user interface object that is, optionally, displayed on thedisplay screen of devices 100, 300, and/or 500 (FIGS. 1A, 3, and 5A-5B).For example, an image (e.g., icon), a button, and text (e.g., hyperlink)each optionally constitute an affordance.

As used herein, the term “focus selector” refers to an input elementthat indicates a current part of a user interface with which a user isinteracting. In some implementations that include a cursor or otherlocation marker, the cursor acts as a “focus selector” so that when aninput (e.g., a press input) is detected on a touch-sensitive surface(e.g., touchpad 355 in FIG. 3 or touch-sensitive surface 451 in FIG. 4B)while the cursor is over a particular user interface element (e.g., abutton, window, slider, or other user interface element), the particularuser interface element is adjusted in accordance with the detectedinput. In some implementations that include a touch screen display(e.g., touch-sensitive display system 112 in FIG. 1A or touch screen 112in FIG. 4A) that enables direct interaction with user interface elementson the touch screen display, a detected contact on the touch screen actsas a “focus selector” so that when an input (e.g., a press input by thecontact) is detected on the touch screen display at a location of aparticular user interface element (e.g., a button, window, slider, orother user interface element), the particular user interface element isadjusted in accordance with the detected input. In some implementations,focus is moved from one region of a user interface to another region ofthe user interface without corresponding movement of a cursor ormovement of a contact on a touch screen display (e.g., by using a tabkey or arrow keys to move focus from one button to another button); inthese implementations, the focus selector moves in accordance withmovement of focus between different regions of the user interface.Without regard to the specific form taken by the focus selector, thefocus selector is generally the user interface element (or contact on atouch screen display) that is controlled by the user so as tocommunicate the user's intended interaction with the user interface(e.g., by indicating, to the device, the element of the user interfacewith which the user is intending to interact). For example, the locationof a focus selector (e.g., a cursor, a contact, or a selection box) overa respective button while a press input is detected on thetouch-sensitive surface (e.g., a touchpad or touch screen) will indicatethat the user is intending to activate the respective button (as opposedto other user interface elements shown on a display of the device).

As used in the specification and claims, the term “characteristicintensity” of a contact refers to a characteristic of the contact basedon one or more intensities of the contact. In some embodiments, thecharacteristic intensity is based on multiple intensity samples. Thecharacteristic intensity is, optionally, based on a predefined number ofintensity samples, or a set of intensity samples collected during apredetermined time period (e.g., 0.05, 0.1, 0.2, 0.5, 1, 2, 5, 10seconds) relative to a predefined event (e.g., after detecting thecontact, prior to detecting liftoff of the contact, before or afterdetecting a start of movement of the contact, prior to detecting an endof the contact, before or after detecting an increase in intensity ofthe contact, and/or before or after detecting a decrease in intensity ofthe contact). A characteristic intensity of a contact is, optionally,based on one or more of: a maximum value of the intensities of thecontact, a mean value of the intensities of the contact, an averagevalue of the intensities of the contact, a top 10 percentile value ofthe intensities of the contact, a value at the half maximum of theintensities of the contact, a value at the 90 percent maximum of theintensities of the contact, or the like. In some embodiments, theduration of the contact is used in determining the characteristicintensity (e.g., when the characteristic intensity is an average of theintensity of the contact over time). In some embodiments, thecharacteristic intensity is compared to a set of one or more intensitythresholds to determine whether an operation has been performed by auser. For example, the set of one or more intensity thresholdsoptionally includes a first intensity threshold and a second intensitythreshold. In this example, a contact with a characteristic intensitythat does not exceed the first threshold results in a first operation, acontact with a characteristic intensity that exceeds the first intensitythreshold and does not exceed the second intensity threshold results ina second operation, and a contact with a characteristic intensity thatexceeds the second threshold results in a third operation. In someembodiments, a comparison between the characteristic intensity and oneor more thresholds is used to determine whether or not to perform one ormore operations (e.g., whether to perform a respective operation orforgo performing the respective operation), rather than being used todetermine whether to perform a first operation or a second operation.

In some embodiments, a portion of a gesture is identified for purposesof determining a characteristic intensity. For example, atouch-sensitive surface optionally receives a continuous swipe contacttransitioning from a start location and reaching an end location, atwhich point the intensity of the contact increases. In this example, thecharacteristic intensity of the contact at the end location is,optionally, based on only a portion of the continuous swipe contact, andnot the entire swipe contact (e.g., only the portion of the swipecontact at the end location). In some embodiments, a smoothing algorithmis, optionally, applied to the intensities of the swipe contact prior todetermining the characteristic intensity of the contact. For example,the smoothing algorithm optionally includes one or more of: anunweighted sliding-average smoothing algorithm, a triangular smoothingalgorithm, a median filter smoothing algorithm, and/or an exponentialsmoothing algorithm. In some circumstances, these smoothing algorithmseliminate narrow spikes or dips in the intensities of the swipe contactfor purposes of determining a characteristic intensity.

The intensity of a contact on the touch-sensitive surface is,optionally, characterized relative to one or more intensity thresholds,such as a contact-detection intensity threshold, a light press intensitythreshold, a deep press intensity threshold, and/or one or more otherintensity thresholds. In some embodiments, the light press intensitythreshold corresponds to an intensity at which the device will performoperations typically associated with clicking a button of a physicalmouse or a trackpad. In some embodiments, the deep press intensitythreshold corresponds to an intensity at which the device will performoperations that are different from operations typically associated withclicking a button of a physical mouse or a trackpad. In someembodiments, when a contact is detected with a characteristic intensitybelow the light press intensity threshold (e.g., and above a nominalcontact-detection intensity threshold below which the contact is nolonger detected), the device will move a focus selector in accordancewith movement of the contact on the touch-sensitive surface withoutperforming an operation associated with the light press intensitythreshold or the deep press intensity threshold. Generally, unlessotherwise stated, these intensity thresholds are consistent betweendifferent sets of user interface figures.

An increase of characteristic intensity of the contact from an intensitybelow the light press intensity threshold to an intensity between thelight press intensity threshold and the deep press intensity thresholdis sometimes referred to as a “light press” input. An increase ofcharacteristic intensity of the contact from an intensity below the deeppress intensity threshold to an intensity above the deep press intensitythreshold is sometimes referred to as a “deep press” input. An increaseof characteristic intensity of the contact from an intensity below thecontact-detection intensity threshold to an intensity between thecontact-detection intensity threshold and the light press intensitythreshold is sometimes referred to as detecting the contact on thetouch-surface. A decrease of characteristic intensity of the contactfrom an intensity above the contact-detection intensity threshold to anintensity below the contact-detection intensity threshold is sometimesreferred to as detecting liftoff of the contact from the touch-surface.In some embodiments, the contact-detection intensity threshold is zero.In some embodiments, the contact-detection intensity threshold isgreater than zero.

In some embodiments described herein, one or more operations areperformed in response to detecting a gesture that includes a respectivepress input or in response to detecting the respective press inputperformed with a respective contact (or a plurality of contacts), wherethe respective press input is detected based at least in part ondetecting an increase in intensity of the contact (or plurality ofcontacts) above a press-input intensity threshold. In some embodiments,the respective operation is performed in response to detecting theincrease in intensity of the respective contact above the press-inputintensity threshold (e.g., a “down stroke” of the respective pressinput). In some embodiments, the press input includes an increase inintensity of the respective contact above the press-input intensitythreshold and a subsequent decrease in intensity of the contact belowthe press-input intensity threshold, and the respective operation isperformed in response to detecting the subsequent decrease in intensityof the respective contact below the press-input threshold (e.g., an “upstroke” of the respective press input).

In some embodiments, the device employs intensity hysteresis to avoidaccidental inputs sometimes termed “jitter,” where the device defines orselects a hysteresis intensity threshold with a predefined relationshipto the press-input intensity threshold (e.g., the hysteresis intensitythreshold is X intensity units lower than the press-input intensitythreshold or the hysteresis intensity threshold is 75%, 90%, or somereasonable proportion of the press-input intensity threshold). Thus, insome embodiments, the press input includes an increase in intensity ofthe respective contact above the press-input intensity threshold and asubsequent decrease in intensity of the contact below the hysteresisintensity threshold that corresponds to the press-input intensitythreshold, and the respective operation is performed in response todetecting the subsequent decrease in intensity of the respective contactbelow the hysteresis intensity threshold (e.g., an “up stroke” of therespective press input). Similarly, in some embodiments, the press inputis detected only when the device detects an increase in intensity of thecontact from an intensity at or below the hysteresis intensity thresholdto an intensity at or above the press-input intensity threshold and,optionally, a subsequent decrease in intensity of the contact to anintensity at or below the hysteresis intensity, and the respectiveoperation is performed in response to detecting the press input (e.g.,the increase in intensity of the contact or the decrease in intensity ofthe contact, depending on the circumstances).

For ease of explanation, the descriptions of operations performed inresponse to a press input associated with a press-input intensitythreshold or in response to a gesture including the press input are,optionally, triggered in response to detecting either: an increase inintensity of a contact above the press-input intensity threshold, anincrease in intensity of a contact from an intensity below thehysteresis intensity threshold to an intensity above the press-inputintensity threshold, a decrease in intensity of the contact below thepress-input intensity threshold, and/or a decrease in intensity of thecontact below the hysteresis intensity threshold corresponding to thepress-input intensity threshold. Additionally, in examples where anoperation is described as being performed in response to detecting adecrease in intensity of a contact below the press-input intensitythreshold, the operation is, optionally, performed in response todetecting a decrease in intensity of the contact below a hysteresisintensity threshold corresponding to, and lower than, the press-inputintensity threshold.

As used herein, an “installed application” refers to a softwareapplication that has been downloaded onto an electronic device (e.g.,devices 100, 300, and/or 500) and is ready to be launched (e.g., becomeopened) on the device. In some embodiments, a downloaded applicationbecomes an installed application by way of an installation program thatextracts program portions from a downloaded package and integrates theextracted portions with the operating system of the computer system.

As used herein, the terms “open application” or “executing application”refer to a software application with retained state information (e.g.,as part of device/global internal state 157 and/or application internalstate 192). An open or executing application is, optionally, any one ofthe following types of applications:

-   -   an active application, which is currently displayed on a display        screen of the device that the application is being used on;    -   a background application (or background processes), which is not        currently displayed, but one or more processes for the        application are being processed by one or more processors; and    -   a suspended or hibernated application, which is not running, but        has state information that is stored in memory (volatile and        non-volatile, respectively) and that can be used to resume        execution of the application.

As used herein, the term “closed application” refers to softwareapplications without retained state information (e.g., state informationfor closed applications is not stored in a memory of the device).Accordingly, closing an application includes stopping and/or removingapplication processes for the application and removing state informationfor the application from the memory of the device. Generally, opening asecond application while in a first application does not close the firstapplication. When the second application is displayed and the firstapplication ceases to be displayed, the first application becomes abackground application.

Attention is now directed towards embodiments of user interfaces (“UI”)and associated processes that are implemented on an electronic device,such as portable multifunction device 100, device 300, or device 500.

FIGS. 6A-6V illustrate exemplary user interfaces for managing exposurecompensation using an electronic device in accordance with someembodiments. The user interfaces in these figures are used to illustratethe processes described below, including the processes in FIG. 7.

FIG. 6A illustrates electronic device 600 displaying a camera userinterface, which includes a live preview 630 that optionally extendsfrom the top of the display to the bottom of the display. Device 600optionally includes one or more features of device 100, device 300, ordevice 500.

Live preview 630 shows a particular scene (e.g., sky in FIG. 6A) that isin the field-of-view of one or more cameras. Live preview 630 is arepresentation of a (e.g., partial) field-of-view of one or more camerasof device 600 (“the FOV”). Live preview 630 is based on images detectedin the FOV. In some embodiments, device 600 captures images using aplurality of camera sensors and combines them to display live preview630. In some embodiments, device 600 captures images using a singlecamera sensor to display live preview 630.

The camera user interface of FIG. 6A includes indicator region 602 andcontrol region 606. Indicator region 602 and control region 606 areoverlaid on live preview 630 such that indicators and controls can bedisplayed concurrently with live preview 630. Camera display region 604is sandwiched between indicator region 602 and control region 606 and issubstantially not overlaid with indicators or controls.

As illustrated in FIG. 6A, indicator region 602 includes indicators,such as flash indicator 602 a and animated image indicator 602 b. Flashindicator 602 a indicates whether the flash is on, off, or in anothermode (e.g., automatic mode). In FIG. 6A, flash indicator 602 a indicatesto the user that the flash is off. Moreover, animated image indicator602 b indicates whether the camera is configured to capture a singleimage or a plurality of images (e.g., in response to detecting a requestto capture media). In some embodiments, indicator region 602 is overlaidonto live preview 630 and optionally includes a colored (e.g., gray;translucent) overlay.

As illustrated in FIG. 6A, camera display region 604 includes livepreview 630 and zoom affordances 622. Here, a “1×” zoom affordance isselected, which indicates that live preview 630 is being displayed at a1× zoom level.

As illustrated in FIG. 6A, control region 606 includes shutteraffordance 610, camera switcher affordance 614, a representation ofmedia collection 612, and camera setting affordances 626. Shutteraffordance 610, when activated, causes device 600 to capture media(e.g., a photo), using the one or more camera sensors, based on thecurrent state of live preview 630 and the current state of the cameraapplication. The captured media is stored locally at electronic device600 and/or transmitted to a remote server for storage. Camera switcheraffordance 614, when activated, causes device 600 to switch to showingthe field-of-view of a different camera in live preview 630, such as byswitching between a rear-facing camera sensor and a front-facing camerasensor. The representation of media collection 612 illustrated in FIG.6A is a representation of media (an image, a video) that was mostrecently captured by device 600. In some embodiments, in response todetecting a gesture on media collection 612, device 600 displays asimilar user interface to the user interface illustrated in FIG. 8A(discussed below). As illustrated in FIG. 6A, camera setting affordances626 include flash setting affordance 626 a, animated image capturesetting affordance 626 b, aspect ratio setting affordance 626 c,exposure compensation setting affordance 626 d, timer setting affordance626 e, and filter setting affordance 626 f. Camera setting affordances626, when selected (e.g., via a gesture detected on a particular camerasetting affordance), causes device 600 to change (or initiated processesfor changing) camera settings that associated with a particular cameramode. For example, flash setting affordance 626 a, when activated,causes device 600 to turn on/off a flash mode, and timer affordance 626d, when selected, causes device to initiate a process for setting aself-delay timer. In some embodiments, control region 606 is overlaidonto live preview 630 and optionally includes a colored (e.g., gray;translucent) overlay. At FIG. 6A, device 600 detects tap gesture 650 aon (e.g., at a location corresponding to) exposure compensation settingaffordance 626 d.

As illustrated in FIG. 6B, in response to detecting tap gesture 650 a,device 600 displays exposure compensation indicator 602 d in indicatorregion 602 concurrently with live preview 630. In some embodiments,device 600 displays exposure compensation indicator 602 d in indicatorregion 602 because device 600 activated an exposure compensation mode inresponse to detecting tap gesture 650 a.

Exposure compensation indicator 602 d includes exposure compensationvalue representation 602 d 1 and clipping indication 602 d 2. Each ofexposure compensation value representation 602 d 1 and clippingindication 602 d 2 is displayed outside of camera display region 604. Insome embodiments, when live preview 630 extends into indicator region602 and/or control region 606 and in response to receiving a request todisplay capture media representative of live preview 630, device 600displays a representation of the portion of live preview 630 that isshown in camera display region 604 without displaying the representationof the portions of live preview 630 in indicator region 602 and controlregion 606. Thus, in some embodiments, exposure compensation valuerepresentation 602 d 1 and clipping indication 602 d 2 are displayedoutside of camera display region 604 so that the portion of live preview630 (e.g., in camera display region 604) that is shown in response tothe receiving the request to display captured media representative oflive preview 630 is not obstructed.

As illustrated in FIG. 6B, exposure compensation value representation602 d 1 is a numerical value (“0” in FIG. 6B) that indicates a level ofexposure that device 600 will use to capture media in response toreceiving a request to capture media (e.g., such as in response todetecting a gesture on shutter affordance 610). In some embodiments, thelevel of exposure indicated by exposure compensation valuerepresentation 602 d 1 can be combined with one or more other exposurecompensation values (e.g., an exposure compensation bias value). In someembodiments, device 600 will be configured to capture media using atotal compensation value (e.g., a combination of the level of exposurecompensation indicated by exposure compensation value representation 602d 1 combined with other exposure compensation value(s)) in response toreceiving a request to capture media, as discussed below (e.g., in FIGS.6F-6I).

In FIG. 6B, clipping indication 602 d 2 indicates a magnitude and a typeof predicted clipping that is predicted to occur in response todetecting a request to capture current media. As used herein, “currentmedia” is (1) media that is representative of live preview 630 and (2)media that is (or is to be) captured in response to detecting a requestto capture media while device 600 is configured to capture media at thelevel of exposure indicated by exposure compensation valuerepresentation 602 d 1 and/or a total level of exposure compensation. Asdescribed in further detail below, the magnitude of the predictedclipping is represented by the size (e.g., length, width), boldness,and/or opacity of clipping indication 602 d 2. Moreover, the type ofpredicted clipping is represented by the position of clipping indication602 d 2. As illustrated in FIGS. 6B and 6J, clipping indication 602 d 2can indicate the predicted occurrence of two types of clipping,highlight clipping and shadow clipping. In some embodiments, highlightclipping is predicted to occur when a determination is made that a setof brightness intensity values (e.g., white values or highlights of animage (e.g., to be captured)) of within the FOV (or current media) areabove a range of brightness intensity values (e.g., a non-zero range)that can be accurately captured and/or represented in current media. Inother words, the set of brightness intensity values are too bright andcannot accurately be captured and/or represented (e.g., in currentmedia) by device 600. In some embodiments, shadow clipping is predictedto occur when a determination is made that brightness intensity values(e.g., black values or shadows of an image (e.g., to be captured)) ofthe FOV (or current media) are below the range of brightness intensityvalues that can be accurately captured and/or represented in currentmedia. In other words, the set of brightness intensity values are toodark and cannot accurately be captured and/or represented (e.g., incurrent media) by device 600. In FIG. 6B, clipping indication 602 d 2indicates that highlight clipping is predicted to occur because clippingindication 602 d 2 is positioned to be the rightmost tick mark ofexposure compensation indicator 602 d. However, clipping indication 602d 2 of FIG. 6J indicates that shadow clipping is predicted to occurbecause clipping indication 602 d 2 is positioned to be the leftmosttick mark (or on the opposite side of where clipping indication 602 d 2is illustrated in FIG. 6A) of exposure compensation indicator 602 d inFIG. 6J.

As illustrated in FIG. 6B, in response to detecting tap gesture 650 a,device 600 also replaces camera setting affordances 626 with exposurecompensation control 636 in control region 606. Exposure compensationcontrol 636 is a slider that is displayed with value indication 636 apositioned at a tick mark on the slider. The positioning of valueindication 636 a represents a value (e.g., 0) of the current level ofexposure compensation, which matches the exposure compensation valueindicated by exposure compensation value representation 602 d 1. Duringthe transition between FIGS. 6B and 6C, the environment gets brighterand device 600 detects changes in the FOV that indicate that theenvironment of the scene in the FOV is brighter.

At FIG. 6C, in response to detecting the change in the FOV, adetermination is made that a second amount (or level) of highlightclipping is predicted to occur. At FIG. 6C, the second amount ofhighlight clipping that is predicted to occur is greater than the amountof highlight clipping that was predicted to occur in FIG. 6B. At FIG.6C, the second amount is greater than the amount of highlight clippingthat was predicted to occur in FIG. 6B because the level of brightnessin the environment (e.g., as seen when comparing live preview 630illustrated in FIGS. 6B-6C) has increased and the current level ofexposure compensation has remained the same (e.g., as shown by exposurecompensation value representation 602 d 1). Thus, at FIG. 6C, device 600is detecting more brightness intensity values that are above the rangeof brightness intensity values than device 600 was detecting in FIG. 6B(e.g., to display live preview 630).

As illustrated in FIG. 6C, in response to detecting the change in theFOV and because the determination was made that the second amount ofhighlight clipping is predicted to occur, device 600 increases the sizeof clipping indication 602 d 2, which indicates that more highlightclipping is predicted to occur in FIG. 6C than the highlight that waspredicted to occur in FIG. 6B. Thus, in FIG. 6C, clipping indication 602d 2 indicates the type and amount of clipping that is predicted tooccur. In particular, clipping indication 602 d 2 of FIG. 6C is longerand wider than clipping indication 602 d 2 of FIG. 6B. During thetransition between FIGS. 6C and 6D, the environment gets brighter anddevice 600 detects more changes in the FOV that indicate that theenvironment of the scene in the FOV is brighter.

At FIG. 6D, a determination is made that a third amount of highlightclipping is predicted to occur. At FIG. 6D, the third amount ofhighlight clipping that is predicted to occur is greater than the secondamount of highlight that was predicted to occur in FIG. 6C. Here, thethird amount of highlight clipping is greater than the second amount ofhighlight clipping because the level of brightness in the environment(e.g., as seen when comparing live preview 630 illustrated in FIGS.6C-6D) has increased, and the current level of exposure compensation hasremained the same (e.g., as shown by exposure compensation valuerepresentation 602 d 1). At FIG. 6D, the determination is made that thethird amount of highlight clipping is predicted to occur using one ormore similar techniques as described above in relation to FIG. 6C.

As illustrated in FIG. 6D, in response to detecting the change in theFOV (e.g., at FIG. 6C) and because the determination was made that thethird amount of highlight clipping is predicted to occur, device 600increases the size of clipping indication 602 d 2, which indicates thatthe third amount of highlight clipping that is predicted to occur isgreater than the second amount of highlight that was predicted to occurin FIG. 6C (e.g., using one or more similar techniques as describedabove in relation to FIG. 6C). Thus, in FIG. 6D, clipping indication 602d 2 indicates the type and amount of clipping that is predicted tooccur. In some embodiments, device 600 displays an animation of clippingindication 602 d 2 growing in size from the size of clipping indication602 d 2 of FIG. 6B to the size of clipping indication 602 d 2 of FIG.6D. At FIG. 6D, device 600 detects rightward swipe gesture 650 d onexposure compensation control 636.

As illustrated in FIG. 6E, in response to detecting rightward swipegesture 650 d, device 600 updates exposure compensation control 636 suchthat value indication 636 a is positioned at a value (e.g., −0.2) thatis representative of an updated level of exposure compensation.Moreover, device 600 also updates exposure compensation valuerepresentation 602 d 1 to reflect the value (e.g., −0.2) that isrepresentative of the updated level of exposure compensation. The valueof the updated level of exposure compensation has decreased in FIG. 6Ewhen compared to FIG. 6D.

In FIG. 6E, because the current level of exposure compensation haschanged (e.g., from 0 to −0.2), a determination is made that a fourthamount of highlight clipping is predicted to occur. At FIG. 6E, thefourth amount of highlight clipping that is predicted to occur is lessthan the third amount of highlight clipping that was predicted to occurin FIG. 6D. At FIG. 6E, the fourth amount is less than the third amountbecause the level of the exposure compensation that device 600 will useto capture current media has decreased (e.g., from 0 to −0.2). Whendevice 600 uses a lower exposure compensation value to capture currentmedia, device 600 is configured to capture lower brightness intensityvalues (e.g., fewer whites) in response to receiving a request tocapture media. Capturing lower brightness values in effect leads todevice 600 capturing less brightness intensity values that are above therange of brightness intensity values. As illustrated in FIG. 6E, becausethe determination is made that the fourth amount of clipping ispredicted to occur, device 600 shrinks the size of clipping indication602 d 2, which indicates that the fourth amount of clipping that ispredicted to occur is less than the third amount of clipping that ispredicted to occur. Thus, in FIG. 6E, clipping indication 602 d 2indicates the type and amount of clipping that is predicted to occur.

As shown FIG. 6E, device 600 also darkens live preview 630 to reflectthe media that will be captured based on the updated level of exposurecompensation. Here, live preview 630 is darker (as compared to livepreview 630 of FIG. 6D) because device 600 is configured to capturelower brightness intensity values in response to receiving a request tocapture media (e.g., based on the lower exposure compensation value). AtFIG. 6E, device 600 detects downward swipe gesture 650 e in cameradisplay region 604.

As illustrated in FIG. 6F, in response to detecting downward swipegesture 650 e, device 600 replaces exposure compensation control 636with camera mode affordances 620 in control region 606. Camera modeaffordances 620 indicate which camera mode is currently selected andenables the user to change the camera mode. In FIG. 6F, camera modesaffordances 620 a-620 e are displayed. Camera mode affordances 620indicate that a photo camera mode is active as indicated by photo cameramode affordance 620 c and “Photo” being bolded. As shown in FIG. 6F,device 600 also continues to display exposure compensation indicator 602d, although exposure compensation control 636 has ceased to bedisplayed. In FIG. 6F, continuing to display exposure compensationindicator 602 d includes maintaining exposure compensation valuerepresentation 602 d 1 at the same exposure compensation value (e.g.,−0.2) and clipping indication 602 d 2 at the same size in which theywere displayed in FIG. 6E. Thus, in FIG. 6F, ceasing to displaycompensation control 636 had no impact on the current value of exposurecompensation (e.g., indicated by exposure compensation valuerepresentation 602 d 1) or the determination of the predicted clipping(e.g., as indicated by clipping indication 602 d 2). At FIG. 6F, device600 detects press-and-hold gesture 650 f in (e.g., at a locationcorresponding to) camera display region 604.

As illustrated in FIG. 6G, in response to detecting press-and-holdgesture 650 f, device 600 locks an autofocus setting on device 600, suchthat device 600 focuses one or more of its cameras at a particular focusdistance (e.g., location) in the FOV. In FIG. 6G, the locationcorresponds to the area of the box of compensation bias control 644,which is displayed in camera display region 604 in FIG. 6G. Compensationbias control 644 is displayed with value indication 644 a, which ispositioned at a location on compensation bias control 644 thatcorresponds to the current exposure compensation bias value with whichdevice 600 is currently configured to capture current media (e.g., inresponse to receiving a request to capture media).

At FIG. 6G, device 600 detects downward swipe gesture 650 g in cameradisplay region 604. FIGS. 6H-6I show alternative user interfaces thatcan be displayed in response to detecting downward swipe gesture 650 g.

As illustrated in FIG. 6H, in response to detecting downward swipegesture 650 g, device 600 updates compensation bias control 644, suchthat value indication 644 a is displayed at a new position oncompensation bias control 644 to indicate that an updated exposurecompensation bias value has been updated. The updated exposurecompensation bias value of FIG. 6H is lower than the exposurecompensation bias value of 6G. Thus, as illustrated in FIG. 6H, livepreview 630 is darkened because the compensation bias value is lower. AtFIG. 6H, device 600 is configured to capture media based on a totalcompensation value (e.g., the sum of exposure compensation value that isrepresented by exposure compensation value representation 602 d 1 andthe updated exposure compensation bias value). However, as illustratedin FIG. 6H, device 600 does not update the exposure compensationindicator 602 d to reflect the change in the total exposurecompensation. In some embodiments, at FIG. 6H, device 600 displays arepresentation of the total exposure compensation concurrently withexposure compensation indicator 602 d (e.g., as the compensationindicator is displayed with the same exposure compensation valuerepresentation (e.g., −0.2) and clipping indication 602 d 2 is the samesize). In some embodiments, the representation of the total exposurecompensation is displayed in camera display region 604, while exposurecompensation indicator 602 d remains displayed in indicator region 602.

Alternatively to FIG. 6H, as illustrated in FIG. 6I, device 600 updatescompensation bias control 644 and live preview 630 in response todetecting downward gesture 650 g, using similar techniques to thosedescribed above in FIG. 6H. However, in FIG. 6I, device 600 updatesexposure compensation indicator 602 d (e.g., which was not updated inFIG. 6H) to reflect the change in the total exposure compensation. Forexample, device 600 updates exposure compensation value representation602 d 1 to reflect that the total exposure compensation is −0.3 andupdates clipping indication 602 d 2 to reflect that less predictedclipping is predicted to occur (e.g., because of the lower totalexposure compensation value using techniques as described above) inresponse to a request to capture current media. At FIG. 6H or 6I, device600 detects a change in the FOV.

At FIG. 6J, in response to detecting the change in the FOV (e.g., atFIG. 6H or 6I), a determination is made that the scene in the FOV haschanged. As illustrated in FIG. 6J, live preview 630 shows a pair ofshoes on a dark surface while live preview 630 of 6I showed a sky. Whencompared to live preview 630 of FIG. 6I, live preview 630 of FIG. 6J isconsiderably darker because the scene in the FOV is considerably darker.

At FIG. 6J, because the determination is made that the scene has changedin the FOV, device 600 resets the exposure compensation bias value to adefault exposure compensation bias value (e.g., the compensation biasvalue that was set before detecting gestures 650 f in FIG. 6F or 650 gin FIG. 6G). As illustrated in FIG. 6J, device 600 also ceases todisplay compensation bias indicator 644 because of this scene changedetermination. Notably, at FIG. 6J, device 600 remains configured tocapture the current media via the level of exposure compensation (e.g.,−0.2) that was indicated by exposure compensation value indication 602 d2 in FIG. 6F (e.g., before the compensation bias value was displayedand/or adjusted (e.g., in FIGS. 6F-6G)). Thus, a compensation bias valuethat is set goes away (e.g., is set back to the default value) when thescene in the FOV changes, but an exposure compensation value (e.g., viaexposure compensation control 636) that is set is maintainedirrespective of a determination that the scene has changed in the FOV.

At FIG. 6J, a determination is also made that shadow clipping ispredicted to occur because the level of brightness in the environment inthe new scene (e.g., shoes on a dark surface) has considerablydecreased. In particular, the determination is made that shadow clippingis predicted to occur because a determination is made that the set ofbrightness intensity values (e.g., black values or shadows of an image(e.g., to be captured)) in the FOV (or current media) are below therange of brightness intensity values that can be accurately representedor captured. The determination that shadow clipping is predicted tooccur is based on the level of brightness in the environment and thecurrent level of exposure compensation (e.g., −0.2, as shown by exposurecompensation value representation 602 d 1).

As illustrated FIG. 6J, because the determination is made that shadowclipping is predicted to occur, device 600 displays clipping indication602 d 2 as the leftmost tick mark of exposure compensation indicator 602d (e.g., instead of being displayed as the rightmost tick mark ofexposure compensation indication 602 when highlight clipping waspredicted to occur in FIG. 6F). In FIG. 6J, the size of clippingindication 602 d 2 has also changed to reflect the magnitude (e.g.,amount or level) of the shadow clipping that is predicted to occur whendevice 600 is configured to capture media at the current level ofexposure compensation (e.g., −0.2). At FIG. 6J, device 600 detects achange in the FOV.

At FIG. 6K, in response to detecting the change in the FOV, adetermination is made that the scene has changed in the FOV. Whencompared to live preview 630 of FIG. 6J, live preview 630 of FIG. 6K isconsiderably darker because the scene in the FOV of FIG. 6K isconsiderably darker. At FIG. 6K, a determination is also made that asecond amount of shadow clipping is predicted to occur, using one ormore techniques as described above (e.g., in FIGS. 6B-6J). At FIG. 6K,the second amount of shadow clipping is greater than the amount ofshadow clipping that was predicted to occur in FIG. 6J because a darkerscene is in the FOV of the one or more cameras and the current level ofexposure compensation has remained the same.

As illustrated in FIG. 6K, because the determination is made that thesecond amount of shadow clipping is predicted to occur, device 600increases the size of clipping indication 602 d 2 while maintainingdisplay of clipping indication 602 d 2 on the left side of exposurecompensation indicator 602 d. Thus, in FIG. 6K, clipping indication 602d 2 indicates the type and amount of clipping that is predicted tooccur. In addition, live preview 630 is updated to show the new scene.At FIG. 6K, device 600 detects tap gesture 650 k on exposurecompensation indicator 602 d.

As illustrated in FIG. 6L, in response to detecting tap gesture 650 k,device 600 replaces display of camera affordances 620 with display ofexposure compensation control 636 that includes value indication 636 a.At FIG. 6L, device 600 detects leftward swipe gesture 650 l on exposurecompensation control 636.

As illustrated in FIG. 6M, in response to detecting leftward swipegesture 650 l, device 600 updates the level of the exposurecompensation, which is indicated via the new value (e.g., 1.0)represented by exposure compensation value representation 602 d 1 and isalso displayed above value indication 636 a on exposure compensationcontrol 636. The new level of exposure compensation (e.g., 1.0 in FIG.6M) is higher than the previous level of exposure compensation (e.g.,−0.2 in FIG. 6L).

At FIG. 6M, a determination is made that minimal (or no clipping) ispredicted to occur (or clipping less than a (e.g., non-zero) thresholdlevel of clipping is predicted to occur), using one or more similartechniques to those described above. Thus, in other words, adetermination is made that device 600 will be able to accuratelyrepresent or capture current media with an amount of clipping that isbelow the (e.g., non-zero) threshold amount of clipping. As illustratedin FIG. 6M, because the determination that minimal or no clipping ispredicted to occur (e.g., or clipping less than the (e.g., non-zero)threshold level of clipping is predicted to occur), device 600 ceases todisplay clipping indication 602 d 2. At FIG. 6M, device 600 detectsleftward swipe gesture 650 m on exposure compensation control 636 a.

As illustrated in FIG. 6N, in response to detecting leftward swipegesture 650 m, device 600 updates the level of the exposurecompensation, which is indicated via the new value (e.g., 1.5)represented by exposure compensation value representation 602 d 1 and isdisplayed above value indication 636 a on exposure compensation control636. The new level of exposure compensation (e.g., 1.5 in FIG. 6M) ishigher than the previous level of exposure compensation (e.g., 1.0 inFIG. 6L). At FIG. 6N, a determination is made that a fifth amount ofhighlight clipping is predicted to occur (e.g., the level of exposurecompensation has been adjusted far enough that highlight clipping ispredicted to occur), using one or more similar techniques discussedabove. As illustrated in FIG. 6N, because the determination is made thatthe fifth amount of highlight (and not shadow) clipping is predicted tooccur, device 600 displays clipping indication 602 d 2 on the right sideof exposure compensation indicator 602 d. Thus, in FIG. 6N, clippingindication 602 d 2 indicates the type and amount of clipping that ispredicted to occur. At FIG. 6N, device 600 detects upward swipe gesture650 n from the bottom of control region 606.

At FIG. 6O, in response to detecting upward swipe gesture 650 n, adetermination is made that a session associated with the use of thecamera application (e.g., the application that corresponds to the camerauser interface) has ended because, for example, device 600 has ceased todisplay (or closed out of) the camera application. In some embodiments,the session associated with the use of the camera application ends whendevice 600 has ceased to display or closed out of the camera applicationfor a predetermined period of time. In some embodiments, the sessionassociated with the use of the camera applications ends when adetermination is made that the camera application has stopped running ondevice 600. In some embodiments, the session associated with the use ofthe camera application ends at a particular time (e.g., at the end ofthe day (a specific time of the day) when the camera application is notin use or when the camera application was interacted with by a user). Insome embodiments, the session associated with the use of the cameraapplication ends after device 600 has been in a locked state for apredetermined period of time. In addition, as illustrated in FIG. 6O,device 600 ceases to display the camera user interface and displays auser interface with application icons 690. Application icons 690includes application icons, such as camera application icon 690 a. AtFIG. 6O, device 600 detects tap gesture 650 o on camera application icon690 a.

As illustrated in FIG. 6P, in response to detecting tap gesture 650 o,device 600 ceases to display the user interface with the applicationicons and displays the camera user interface. As illustrated in FIG. 6P,exposure compensation indicator 602 d is in the same state in which itwas displayed in FIG. 6N. For example, in FIG. 6P, exposure compensationvalue representation 602 d 1 indicates that the current level ofexposure 1.5, which is the same as the level as exposure when the camerauser interface was last displayed in FIG. 6N. At FIG. 6P, device 600detects leftward swipe gesture 650 p at the bottom of control region606.

As illustrated in FIG. 6Q, in response to detecting leftward swipegesture 650 p, device 600 displays a camera user interface that includessettings 692, such as exposure control setting 692 a. At FIG. 6Q,exposure control setting 692 a is set to on, which indicates that thecurrent level of exposure will be maintained and not automaticallyreset. In addition, exposure control setting 692 a indicates thatexposure compensation indicator 602 d will continue to be displayed(e.g., after the exposure compensation is initially set via exposurecompensation control 644). In some embodiments, control setting 692 aindicates that exposure compensation indicator 602 d will always bedisplayed (e.g., irrespective of whether the exposure compensation isinitially set). Looking back at FIGS. 6N-6P, device 600 maintainedexposure compensation indicator 602 d in the same state in FIG. 6P(e.g., after the determination that the session associated with the useof the camera application ended) because control setting 692 a is set toon. At FIG. 6Q, device 600 detects tap gesture 650 q on exposure controlsetting 692 a.

As illustrated in FIG. 6R, in response to detecting tap gesture 650 q,device 600 toggles exposure control setting 692 a from an on state to anoff state. At FIG. 6R, device 600 detects upward swipe gesture 650 r atthe bottom of control region 606.

As illustrated in FIG. 6S, in response to detecting upward swipe gesture650 r, device 600 re-displays the user interface with camera applicationicon 690 a. At FIG. 6S, in response to detecting upward swipe gesture650 r, a determination is made that a session associated with the use ofthe camera application has ended, using similar techniques to thosedescribed above in relation to FIG. 6O. At FIG. 6S, device 600 detectstap gesture 650 s on camera application icon 690 a.

As illustrated in FIG. 6T, in response to detecting tap gesture 650 s,device 600 displays the camera user interface without exposurecompensation indicator 602 d because exposure control setting 692 a isset to on (as opposed to displaying exposure compensation indicator 602d when exposure control setting 692 a was set to off, as describedabove).

FIG. 6U illustrates a camera user interface with exposure compensationindicator 602 d being displayed while device 600 is operating in a videomode, as indicated by video camera mode affordance 602 b and “Video”being bold in FIG. 6U.

FIG. 6V illustrates a camera user interface with exposure compensationindicator 602 d being displayed while device 600 is operating in aportrait mode, as indicated by portrait camera mode affordance 602 e and“Portrait” being bold in FIG. 6V.

FIG. 7 is a flow diagram illustrating a method for managing exposurecompensation using a computer system in accordance with someembodiments. Method 700 is performed at a computer system (e.g., 100,300, 500, 600). The computer has one or more cameras (e.g., one or morecameras (e.g., dual cameras, triple camera, quad cameras, etc.) on thesame side or different sides of the computer system (e.g., a frontcamera, a back camera)) and is in communication with a displaygeneration component (e.g., a display controller, a touch-sensitivedisplay system) and one or more input devices (e.g., a touch-sensitivesurface). Some operations in method 700 are, optionally, combined, theorders of some operations are, optionally, changed, and some operationsare, optionally, omitted.

As described below, method 700 provides an intuitive way for managingexposure compensation. The method reduces the cognitive burden on a userfor managing exposure compensation, thereby creating a more efficienthuman-machine interface. For battery-operated computing systems,enabling a user to manage exposure compensation faster and moreefficiently conserves power and increases the time between batterycharges.

The computer system receives (702) a request to display a camera userinterface (e.g., user interface in FIG. 6B) (e.g., a request to displaythe camera application or a request to switch to a media capture modewithin the camera application).

In response to receiving the request to display the camera userinterface and while the one or more cameras are configured to captureimages (e.g., video, photos) based on a first exposure compensationvalue (e.g., as indicated by 602 d 1) (e.g., a value that represents anamount of exposure that will be used to capture media that correspondsto the representation of the field-of-view of the one or more cameras),the computer system displays (704), via the display generationcomponent, a camera user interface (e.g., user interface in FIG. 6B).

As a part of displaying, via the display generation component, thecamera user interface, the computer system displays (706), via thedisplay generation component, a first representation (e.g., 630) (e.g.,a representation over-time, a live preview feed of data from the camera)of a field-of-view of the one or more cameras (e.g., an open observablearea that is visible to a camera, the horizontal (or vertical ordiagonal) length of an image at a given distance from the camera lens).In some embodiments, the value is a default exposure compensation valuethat is used to capture media irrespective of whether an exposurecompensation mode is enabled or not enabled. In some embodiments, therepresentation of the field-of-view of the one or more cameras isdisplayed in a camera display region.

As a part of displaying the camera user and in accordance with (708) adetermination that a set of exposure compensation criteria is met, wherethe set of exposure compensation criteria includes a criterion that ismet when an exposure compensation mode is enabled (e.g., 692 a in FIG.6Q) (e.g., active), the computer system displays (710), concurrentlywith the representation (e.g., 630) of the field-of-view of the one ormore cameras, an exposure compensation indicator (e.g., 602 d) thatincludes: a representation of the first exposure compensation value(e.g., as indicated by 602 d 1) (e.g., a numerical representation (e.g.,1.5, −1.5), a symbolic retransition); and a visual indication (e.g., 602d 2) that the computer system has determined that clipping (e.g., one ormore areas of the captured media that loses detail as a result of theexposure compensation setting) is predicted to occur in response toreceiving a request to capture media (e.g., receiving an input on 610)that corresponds to the representation (e.g., 630) of the field-of-viewof the one or more cameras. In some embodiments, while the one or morecameras are configured to capture images based on a first exposurecompensation value, the representation of the first exposurecompensation value is (or, alternatively, not) displayed (e.g.,displayed concurrently with, adjacent to, and/or on the representationof the field-of-view of the one or more cameras). In some embodiments,the exposure compensation mode is enabled when the computer system isconfigured to preserve the exposure adjustment when displaying differentrepresentations (e.g., representations that are captured over-time orrepresentations of different scenes) of the field-of-view of the one ormore cameras and/or when the computer system is configured to show anexposure adjustment indicator. In some embodiments, the exposurecompensation mode is enabled when a selection is made on an exposurecompensation indicator and/or when a new exposure compensation is set(e.g., via an exposure adjustment control). In some embodiments, whenclipping occurs, a clipped area can be represented by a minimum ormaximum brightness in a representation of the captured media. In someembodiments, the clipped area in the representation of the capturedmedia has a different level of brightness, highlights, shadows, and/or adifferent level of detail (e.g., less detail) than the area thatcorresponds to the clipped area in the representation of thefield-of-view of the one or more cameras. In some embodiments, therepresentation of the exposure compensation and the visual indication(e.g., that the computer system has determined that clipping ispredicted to occur) are concurrently displayed. In some embodiments, theexposure compensation indicator is displayed in a camera indicatorregion. In some embodiments, the camera indicator region includes aplurality of indicators (e.g., affordances, selectable user interfaceobjects) that configure the computer system to capture media based oneor more camera settings (e.g., exposure settings, flash settings,low-light mode settings, timer settings, etc.). In some embodiments, arepresentation of the exposure compensation value is above the visualindication. In some embodiments, in accordance with a determination thatthe set of exposure compensation criteria is not met, the computersystem forgoes display of the exposure compensation indicator. In someembodiments, in accordance with a determination that the set of exposurecompensation criteria is not met, the first representation is displayedat a default exposure compensation value (e.g., a zero value), where thecomputer system is configured to capture media using the defaultexposure compensation value when the exposure compensation mode is notenabled. In some embodiments, the computer system determines thatclipping is predicted to occur in response to receiving the request tocapture media that corresponds to the representation of thefield-of-view of the one or more cameras by receiving one or moreindications or based on one or more determinations that clipping ispredicted to occur in response to receiving the request to capture mediathat corresponds to the representation of the field-of-view of the oneor more cameras that is made by one or more external devices. Displayingan exposure compensation indicator that includes an exposurecompensation value and an indicator of predicted clipping provides theuser with feedback about the relationship between the current exposurecompensation value, the current scene that is in the field-of-view ofthe camera of the system, and the predicted clipping that can occur whenmedia that corresponds to the current scene is captured. Thus,displaying the exposure compensation indicator allows for a user tovisually ascertain how the adjustment of the current exposurecompensation value and/or the change in scene in the field-of-view ofthe at least one camera will impact the predicted clipping. Providingimproved visual feedback to the user enhances the operability of thesystem and makes the user-system interface more efficient (e.g., byhelping the user to provide proper inputs and reducing user mistakeswhen operating/interacting with the system) which, additionally, reducespower usage and improves battery life of the system by enabling the userto use the system more quickly and efficiently. Displaying an exposurecompensation indicator that includes an exposure compensation value andan indicator of predicted clipping provides the user with feedback aboutthe relationship between the current exposure compensation value, thecurrent scene that is in the field-of-view of the camera of the system,and the predicted clipping that can occur when media that corresponds tothe current scene is captured, which reduces the number of times medianeeds to be captured to obtain an image with reduced (e.g., or little)clipping. Reducing the number of times an operation needs to beperformed enhances the operability of the system and makes theuser-system interface more efficient (e.g., by helping the user toprovide proper inputs and reducing user mistakes whenoperating/interacting with the system) which, additionally, reducespower usage and improves battery life of the system by enabling the userto use the system more quickly and efficiently.

In some embodiments, while displaying the exposure compensationindicator (e.g., 602 d) and in accordance with a determination that theclipping that is predicted to occur is a first type of clipping, thevisual indication is displayed at a first position (e.g., 602 d 2 inFIG. 6B) (e.g., on the display generation component (e.g., a positionon, adjacent to the exposure compensation indicator)). In someembodiments, while displaying the exposure compensation indicator and inaccordance with a determination that the clipping that is predicted tooccur is a second type of clipping that is different from the first typeof clipping, the visual indication is displayed at a second position(e.g., 602 d 2 in FIG. 6J) (e.g., on the display generation component(e.g., a position on, adjacent to the exposure compensation indicator))that is different from the first position. In some embodiments, thefirst type of clipping is clipping that is based on a value of aparameter of the media (e.g., brightness intensity) being above a range((e.g., a capturable range (e.g., a range where brightness intensityvalues can be captured by the computer system), a representable range(e.g., a range where brightness intensity values can be represented bythe computer system)) of brightness intensity values (e.g., clipping ofhighlights, clipping of brighter/white areas)) of values for theparameter (e.g., that is predicted to occur in response to receiving therequest to capture the media (e.g., (e.g., clipping (e.g., that ispredicted to) that occurs when brighter areas (e.g., white areas) of thescene are represented with less detail than other areas of the scene))).In some embodiments, the second type of clipping is clipping based onthe value of the parameter of the media (e.g., a brightness intensity)being below the range ((e.g., a capturable range (e.g., a range wherebrightness intensity values can be captured by the computer system), arepresentable range (e.g., a range where brightness intensity values canbe represented by the computer system)) of brightness intensity values(e.g., crushing of blacks, clipping of darker/black areas)) of valuesfor the parameter (e.g., in response to receiving the request to thecapture media (e.g., show clipping (e.g., clipping (e.g., that ispredicted to) that occurs when darker areas (e.g., black areas) of thescene are represented with less detail than other areas of the scene))).In some embodiments, while displaying the visual indication that isdisplayed at the first position and in accordance with a determinationthat second (e.g., new, subsequent) clipping is predicted to occur inresponse to receiving a request to capture media that corresponds to therepresentation of the field-of-view of the one or more cameras and thesecond clipping is the first type of clipping, the computer systemdisplays the visual indication at the first position; and whiledisplaying the visual indication at the first position and in accordancewith a determination that second (e.g., new, subsequent) clipping ispredicted to occur in response to receiving a request to capture mediathat corresponds to the representation of the field-of-view of the oneor more cameras and the second clipping is the second type of clipping,the computer system displays the visual indication at the secondposition. In some embodiments, the visual indication moves from thefirst position to the second position, or vice-versa. In someembodiments, the first position is on one side of the exposurecompensation indicator (e.g., right/left/top/bottom) and the secondposition is located on the side that is opposite of the side (e.g.,left/right/bottom/top) that the first position is on. Displaying anindicator of predicted clipping at different positions on the exposurecompensation indicator, where each position corresponds to the type ofclipping that is predicted to occur, provides the user with feedback onhow to adjust the current exposure compensation value and/or the changein scene in the field-of-view of the camera to impact (e.g., reduce) thepredicted clipping. Providing improved visual feedback to the userenhances the operability of the system and makes the user-systeminterface more efficient (e.g., by helping the user to provide properinputs and reducing user mistakes when operating/interacting with thesystem) which, additionally, reduces power usage and improves batterylife of the system by enabling the user to use the system more quicklyand efficiently. Displaying an indicator of predicted clipping at oneposition when highlight clipping is predicted to occur and shadowclipping is predicted to occur provides the user with feedback on how toadjust the current exposure compensation value and/or the change inscene in the field-of-view of the camera to impact (e.g., reduce) thepredicted clipping. Providing improved visual feedback to the userenhances the operability of the system and makes the user-systeminterface more efficient (e.g., by helping the user to provide properinputs and reducing user mistakes when operating/interacting with thesystem) which, additionally, reduces power usage and improves batterylife of the system by enabling the user to use the system more quicklyand efficiently.

In some embodiments, prior to a first time (e.g., while displaying theexposure compensation indicator), the visual indication is displayedwith a first visual appearance (e.g., 602 d 2 in FIG. 6B) (e.g.,thickness, size, length, color, boldness, and/or opacity). In someembodiments, at a first time while displaying the exposure compensationindicator and in accordance with a determination that the clipping thatis predicted to occur has changed (e.g., the amount of clipping haschanged, the type of clipping has changed), the computer system displaysthe visual indication (e.g., 602 d 2 in FIG. 6C) with a second visualappearance that is different from the first visual appearance (e.g., 602d 2 in FIG. 6B) (e.g., thickness, size, length, color, boldness, and/oropacity). In some embodiments, in accordance with a determination thatthe clipping that is predicted to occur has increased (or,alternatively, decreased), the visual indicator has a thicker (e.g.,bolder, higher opacity) (e.g., in width) and/or longer (e.g., in height)(or, alternatively, thinner (e.g., in width) and/or shorter (e.g., inheight)) appearance (e.g., second appearance) than the visual indicatorpreviously had (e.g., first appearance). In some embodiments, displayingthe visual indication with a second appearance that is different fromthe first visual appearance includes animating (e.g., animatinggradually) the visual indication changes (e.g., thickening or thinning)from the first visual appearance to the second visual appearance. Insome embodiments, the determination that the clipping that is predictedto occur changes when the field-of-view of the one or more camerasand/or objects in the field-of-view of the one or more cameras changes.In some embodiments, the clipping that is predicted to occur changes inresponse to the first compensation value being changed to a secondexposure compensation value (e.g., via a selectable exposurecompensation control (e.g., a slider)). In some embodiments, theclipping that is predicted to occur changes in response to changes inthe field-of-view of the one or more cameras (e.g., a change in thescene of the field-of-view of the one or more cameras). Displaying anindicator of predicted clipping based on the magnitude of the predictedclipping provides the user with feedback on how to adjust the currentexposure compensation value and/or the change in scene in thefield-of-view of the camera to impact (e.g., reduce) the predictedclipping. Providing improved visual feedback to the user enhances theoperability of the system and makes the user-system interface moreefficient (e.g., by helping the user to provide proper inputs andreducing user mistakes when operating/interacting with the system)which, additionally, reduces power usage and improves battery life ofthe system by enabling the user to use the system more quickly andefficiently.

In some embodiments, the visual indication (e.g., 602 d 2) is displayed,via the display generation component, at a position that is outside of(e.g., away from, not on, not overlapping with) the firstrepresentation. In some embodiments, the exposure compensation indicatoris at a position that is outside of the first representation. Displayingan indicator of predicted clipping away from a representation of thescene provides the user with feedback about the relationship between thecurrent exposure compensation value, the current scene that is in thefield-of-view of the camera of the system, and the predicted clippingthat can occur when media that corresponds to the current scene iscaptured while allowing for viewing of the representation of the scenethat is in the field-of-view of at least one camera of the computersystem with fewer visual elements overlaid on the representation of thescene, which can reduce the number of time it takes to capture anintended scene. Reducing the number of inputs needed to perform anoperation enhances the operability of the system and makes theuser-system interface more efficient (e.g., by helping the user toprovide proper inputs and reducing user mistakes whenoperating/interacting with the system) which, additionally, reducespower usage and improves battery life of the system by enabling the userto use the system more quickly and efficiently.

In some embodiments, while displaying the exposure compensationindicator (e.g., 602 d) that includes the representation of the firstexposure compensation value (e.g., as indicated by 602 d 1 in FIG. 6B),the computer system detects changes in the field-of-view of the one ormore cameras. In some embodiments, in response to detecting changes inthe field-of-view of the one or more cameras, the computer systemcontinues to display the first exposure compensation value (e.g., asindicated by 602 d 1 in FIG. 6C) (e.g., the exposure compensation valueis maintained irrespective of the detected changes in the field-of-viewof the one or more cameras (and/or a change in scene)). In someembodiments, in accordance with a determination that the changes in thefield-of-view of the one or more cameras are above a threshold (e.g.,non-zero threshold) (a threshold that is indicative of the amount ofchanges in the field-of-view amount to a change in a scene), thecomputer system continues to display the exposure compensation indicatorthat includes the first exposure compensation value. In someembodiments, in accordance with a determination that the changes in thefield-of-view of the one or more cameras are above a threshold, thecomputer system continues to display the exposure compensation indicatorthat includes the first exposure compensation value. Maintaining theexposure compensation value when a scene changes reduces the number ofinputs (or eliminates inputs) that it takes to reset the compensationvalue each time the scene changes and also reduces a number of timesthat the exposure compensation is reset when a scene temporarily changesin the field-of-view of the one or more cameras. Reducing the number ofinputs needed to perform an operation enhances the operability of thesystem and makes the user-system interface more efficient (e.g., byhelping the user to provide proper inputs and reducing user mistakeswhen operating/interacting with the system) which, additionally, reducespower usage and improves battery life of the system by enabling the userto use the system more quickly and efficiently.

In some embodiments, the one or more cameras are configured to captureimages based on a cumulative exposure compensation value that is basedon a sum of the first exposure compensation value (e.g., as indicated by602 d 1) and a compensation bias value (e.g., 644 a in FIG. 6H).

In some embodiments, in accordance with a determination that the set ofexposure compensation criteria is met, the computer system concurrentlydisplays (712) an indication of the cumulative exposure compensationvalue (e.g., as indicated by 602 d 1 in FIG. 6I) (e.g., displaying thevalue, displaying a graphical representation corresponding to the value)with the exposure compensation indicator (e.g., 602 d) (e.g., thatincludes the representation of the first compensation value at a firsttime while the one or more cameras are configured to capture imagesbased on the first exposure compensation value). In some embodiments,while displaying the exposure compensation indicator (e.g., thatincludes representation of the first exposure compensation value), thecomputer system receives one or more user inputs (e.g., a tap inputfollowed by a drag input) and, in response to receiving the one or moreuser inputs, the computer system displays the cumulative exposurecompensation value concurrently with the exposure compensation indicatorthat includes the representation of the first compensation value.Displaying an indication of the cumulative exposure compensation valuesprovides the user with feedback about how the exposure compensationvalue and the bias compensation value has impacted the commutativeamount of exposure that will be used to capture media in response to arequest to capture media. Providing improved feedback enhances theoperability of the system and makes the user-system interface moreefficient (e.g., by helping the user to provide proper inputs andreducing user mistakes when operating/interacting with the system)which, additionally, reduces power usage and improves battery life ofthe system by enabling the user to use the system more quickly andefficiently.

In some embodiments, while displaying the exposure compensationindicator (e.g., 602 d) that includes the representation of the firstexposure compensation value (e.g., as indicated by 602 d 1 in FIG. 6G),the computer system detects, via the one or more input devices, one ormore user inputs (e.g., 650 f, 650 g, 650 h) (e.g., a tap input followedby a drag input, such as on a viewfinder of the field-of-view of the oneor more cameras). In some embodiments, in response to detecting the oneor more inputs the computer system changes a compensation bias valuefrom a default compensation bias value (e.g., 644 a in FIG. 6G) (e.g., adefault compensation value (e.g., a value of zero)) to a newcompensation bias value (e.g., 644 a in FIG. 6H) (e.g., a non-zerovalue, a new compensation value). In some embodiments, the computersystem is configured to capture images based on a cumulativecompensation that is based on a sum of the first exposure compensationvalue and the bias compensation value and continues to display therepresentation of the first exposure compensation value. In someembodiments, while displaying exposure compensation indicator thatincludes the representation of the first exposure compensation value andthe compensation bias value is changed to the new compensation value,the computer system detects changes in the field-of-view of the one ormore cameras (e.g., a scene change). In some embodiments, in response todetecting changes in the field-of-view of the one or more cameras and inaccordance with a determination the changes in the field-of-view of theone or more cameras are above a threshold (e.g., non-zero threshold) (athreshold that is indicative of the amount of changes in thefield-of-view amount to a change in a scene) the computer system updates(e.g., resetting) the compensation bias value to the defaultcompensation bias value and continues to display the representation ofthe first exposure compensation value (e.g., 602 d 2 in FIG. 6J). Insome embodiments, in response to detecting changes in the field-of-viewof the one or more cameras and in accordance with a determination thatthe changes in the field-of-view of the one or more cameras are above athreshold, the computer system continues to display the exposurecompensation indicator that includes the indication of the firstexposure compensation value (e.g., the exposure compensation value doesnot change) and foregoes the update of (e.g., reset of) the compensationvalue to the default bias compensation value and/or maintain the biascompensation value (e.g., the bias compensation value does not change).Maintaining the exposure compensation value when a scene changes andupdating the bias value reduces the number of inputs that it takes toreset the compensation value each time the scene changes and alsoreduces a number of times that the exposure compensation is reset when ascene temporarily changes in the field-of-view of the one or morecameras. Reducing the number of inputs needed to perform an operationenhances the operability of the system and makes the user-systeminterface more efficient (e.g., by helping the user to provide properinputs and reducing user mistakes when operating/interacting with thesystem) which, additionally, reduces power usage and improves batterylife of the system by enabling the user to use the system more quicklyand efficiently.

In some embodiments, in accordance with a determination that a set ofreset criteria are met, the computer system sets the first exposurecompensation value to a default compensation value (e.g., as indicatedby 602 d 1 in FIG. 6T). In some embodiments, the set of reset criteriainclude a first criterion that is met when a media-capturing sessionends and a second criterion that is met when anexposure-compensation-preservation mode is not enabled (e.g., 692 a inFIG. 6R). In some embodiments, in accordance with a determination theset of reset criteria are not met, the computer system foregoes settingthe first exposure compensation value to the first (e.g., default)compensation value (e.g., as indicated by 602 d 1 in FIG. 6P). In someembodiments, the computer system maintains the first exposurecompensation value as the value that the first exposure compensationvalue was previous to the media-capturing session ending.

In some embodiments, the set of exposure compensation criteria includesa criterion that is met when an exposure-compensation-preservation modeis enabled (e.g., 692 a in FIG. 6Q). In some embodiments, the set ofexposure compensation criteria includes a criterion that is met when thefirst exposure compensation value is not equal to a default compensationvalue. In some embodiments, the set of exposure compensation criteriaincludes a criterion that is met when exposure-compensation-preservationmode is enabled and the exposure compensation is a default value. Insome embodiments, the set of exposure compensation criteria includes acriterion that is met when the first exposure compensation value is notequal to a default compensation value andexposure-compensation-preservation mode is enabled and the exposurecompensation is a default value. Automatically displaying the exposurecompensation indicator only when prescribed conditions are met allowsdisplay of the indictor without requiring additional user input.Performing an operation when a set of conditions has been met withoutrequiring further user input enhances the operability of the system andmakes the user-system interface more efficient (e.g., by helping theuser to provide proper inputs and reducing user mistakes whenoperating/interacting with the system) which, additionally, reducespower usage and improves battery life of the system by enabling the userto use the system more quickly and efficiently.

In some embodiments, in accordance with a determination that the set ofexposure compensation criteria are not met, the computer system forgoesdisplay of the exposure compensation indicator (e.g., 602 in FIG. 6M).In some embodiments, after displaying the exposure compensationindication, the computer system receives one or more inputs to inactivethe exposure compensation mode (e.g., receiving a input one a selectableuser interface object for configuring the exposure compensation mode),and in response to receiving the one or more inputs, the computer systemceases to display the exposure compensation indicator (e.g., that waspreviously displayed). Automatically displaying the exposurecompensation indicator when prescribed conditions are met allows displayof the indictor without requiring additional user input. Performing anoperation when a set of conditions has been met without requiringfurther user input enhances the operability of the system and makes theuser-system interface more efficient (e.g., by helping the user toprovide proper inputs and reducing user mistakes whenoperating/interacting with the system) which, additionally, reducespower usage and improves battery life of the system by enabling the userto use the system more quickly and efficiently.

In some embodiments, at a second time while displaying the exposurecompensation indicator and in accordance with a determination that theclipping that is predicted to occur has changed, the computer systemdisplays an animation (e.g., 602 in FIGS. 6B-6D) of the exposurecompensation indication transitioning from a first visual state (e.g., afirst position and/or visual appearance (e.g., a thickness, size, color,boldness, opacity) of the indication, a visual state of the firstcompensation value) to a second visual state (e.g., a first positionand/or visual appearance (e.g., a thickness, size, color, boldness,opacity) of the indication, a visual state of the second compensationvalue) that is different from the first visual state. In someembodiments, the animation includes moving the visual indication in adifferent position, thinning/thickening the visual indication, and/ordisplaying the first compensation value changing to a secondcompensation value. Displaying an animation of the exposure compensationindicator changing when the predicted clipping that is predicted tooccur changes provides the user with feedback on the adjustment of thecurrent exposure compensation value and/or the change in scene in thefield-of-view of the at least one camera impacted (e.g., reduced) thepredicted clipping. Providing improved visual feedback to the userenhances the operability of the system and makes the user-systeminterface more efficient (e.g., by helping the user to provide properinputs and reducing user mistakes when operating/interacting with thesystem) which, additionally, reduces power usage and improves batterylife of the system by enabling the user to use the system more quicklyand efficiently.

In some embodiments, while displaying the exposure compensationindicator (e.g., 602 d), the computer system receives a selection (e.g.,650 k) (e.g., tap on exposure compensation indicator) of the exposurecompensation indicator (e.g., 602 d) (e.g., selectable user interfaceobject). In some embodiments, in response to receiving the selection(e.g., 650 k) of the exposure compensation indicator, the computersystem displays a control (e.g., 636) (e.g., an adjustable control, aslider) for adjusting the exposure compensation that, when selected(e.g., 6501), causes the exposure compensation indicator (e.g., asindicated by 602 d 1 in FIG. 6M) to be updated. In some embodiments, theadjustable control includes tick marks, where each tick mark isrepresentative of a value on the adjustable control. In someembodiments, while displaying the control for adjusting the exposurecompensation, the computer system displays a first indication (e.g.,number, slider knob (e.g., bar) on slider track) of a current exposurecompensation value; and, in response to receiving a request (e.g., adragging gesture (e.g., dragging an indication (e.g., slider bar) fromone respective location (e.g., tick mark) on the adjustable control toanother respectable location on the adjustable control)) to adjust thecontrol for adjusting the exposure compensation (and while displayingthe control for adjusting the exposure compensation), the computersystem replaces display of the first indication of the first exposurecompensation value with display of a second indication of the secondexposure compensation value and/or captures media based on the secondexposure compensation value (e.g., without capturing media based on thefirst exposure compensation value). In some embodiments, updating theexposure compensation indicator includes displaying a representation ofa second exposure compensation value that is different from therepresentation of the first exposure compensation value (and ceasing todisplay the representation of the first exposure compensation value). Insome embodiments, updating the exposure compensation indicator includesdisplaying the visual indication (e.g., of the predicted clipping) witha different visual appearance and/or at a different position.

In some embodiments, while displaying the exposure compensationindicator (e.g., 602 d) and in accordance with a determination thatclipping is not predicted to occur (e.g., not likely to occur) inresponse to receiving a request to capture media that corresponds to therepresentation of the field-of-view of the one or more cameras, thecomputer system ceases to display the visual indication (e.g., 602 d 2in FIG. 6M) (e.g., while continuing to display the exposure compensationindicator that includes a representation of the exposure compensationvalue). In some embodiments, clipping is not predicted to occur afterthe first compensation value has been changed to a second compensationvalue. In some embodiments, the clipping is not predicted to occur afterchanges in the field-of-view of the one or more cameras are detected(e.g., after the scene in the field-of-view of the one or more camerashas changed). In some embodiments, while displaying the exposurecompensation indicator and in accordance with a determination thatclipping is predicted to occur in response to receiving a request tocapture media that corresponds to the representation of thefield-of-view of the one or more cameras, the computer system continuesto display the visual indication. Ceasing to display the indication ofthe predicted clipping when prescribed conditions are met provides theuser with feedback on the adjustment of the current exposurecompensation value and/or the change in scene in the field-of-view ofthe at least one camera impacted (e.g., reduced) the predicted clipping.Providing improved visual feedback to the user enhances the operabilityof the system and makes the user-system interface more efficient (e.g.,by helping the user to provide proper inputs and reducing user mistakeswhen operating/interacting with the system) which, additionally, reducespower usage and improves battery life of the system by enabling the userto use the system more quickly and efficiently.

Note that details of the processes described above with respect tomethod 700 (e.g., FIG. 7) are also applicable in an analogous manner tothe methods described below. For example, method 900 optionally includesone or more of the characteristics of the various methods describedabove with reference to method 700. For example, method 700 describedabove may be used to configure a computer system to capture media with arespective amount of exposure compensation that can be displayed usingthe methods described below with respect to method 900. For brevity,these details are not repeated below.

FIGS. 8A-8L illustrate exemplary user interfaces for displaying mediausing an electronic device in accordance with some embodiments. The userinterfaces in these figures are used to illustrate the processesdescribed below, including the processes in FIG. 9.

FIG. 8A illustrates electronic device 600 displaying media gallery userinterface 810 that includes thumbnail media representations 812.Thumbnail media representations 812 include thumbnail mediarepresentations 812 a-812 g, where each of thumbnail mediarepresentations 812 a-812 g is representative of a different media item(e.g., a media item that was captured at a different instance in time).In FIG. 8A, media representations 812 include thumbnail mediarepresentations that are representative of at least two types of mediaitems. For example, thumbnail media representations 812 a, 812 b, and812 g are representative of media items that do not includehigh-dynamic-range (“HDR”) content, and thumbnail media representations812 c-812 h are representative of media items that include HDR content.At FIG. 8A, thumbnail media representations 812 c-812 h are displayedwithout HDR content in media gallery user interface 810, although theyare representative of media items that include HDR content.

As illustrated in FIG. 8A, thumbnail media representations 812 a-812 gare each displayed with a “NON-HDR” or “HDR” label. It should beunderstood that the “NON-HDR” and “HDR” labels are included to allow areader of the subject matter herein to quickly identify whether aparticular thumbnail media representation represents a media item thatdoes not include HDR content (“non-HDR media item”) or a media item thatincludes HDR content (“HDR media item”). Thus, the “NON-HDR” and “HDR”labels should not be considered as being displayed as a part of the userinterface, thumbnail media representations 812 a-812 g, and/or a part ofthe particular media item that is represented by a particular thumbnailmedia representation. At FIG. 8A, device 600 detects tap gesture 850 aon thumbnail media representation 812 a.

As illustrated in FIG. 8B, in response to detecting tap gesture 850 a,device 600 displays media viewer user interface 820 and ceases todisplay media gallery user interface 810. Media viewer user interface820 includes media viewer region 824 positioned between applicationcontrol region 822 and application control region 826. Media viewerregion 824 includes enlarged media representation 824 a, which isrepresentative of the same media item as thumbnail media representation812 a. Thus, enlarged media representation 824 a is representative of anon-HDR media item, which is indicated by the “NON-HDR” label in FIG.8B. Media viewer user interface 820 is not substantially overlaid withcontrols while application control region 822 and application controlregion 826 are substantially overlaid with controls.

Application control region 822 optionally includes an indicator of acurrent time (e.g., “10:20 in FIG. 8B), a current date (“April 18, 2019”in FIG. 8B), a cellular signal status indicator 820 a that shows thestate of a cellular signal, and battery level status indicator 820 bthat shows the state of the remaining battery life of device 600.Application control region 822 also includes back affordance 822 a(e.g., that, when selected, causes device 600 to re-display mediagallery user interface 810) and edit affordance 824 b (e.g., that, whenselected, causes device 600 to display a media editing user interfacethat includes one or more controls for editing a representation of themedia item represented by the currently displayed enlarged mediarepresentation).

Application control region 826 includes some of thumbnail mediarepresentations 812 (e.g., 812 a-812 f) that are displayed in a singlerow. Because enlarged media representation 824 a is displayed, thumbnailmedia representation 812 a is displayed as being selected. Inparticular, thumbnail media representation 812 a is displayed as beingselected in FIG. 8B by being the only thumbnail media representationthat is displayed with spacing (e.g., space between thumbnail mediarepresentation 812 a and thumbnail media presentation 812 b). Inaddition, application control region 826 includes send affordance 826 b(e.g., that, when selected, causes device 600 to initiate a process fortransmitting a media item represented by the enlarged mediarepresentation), favorite affordance 826 c (e.g., that, when selected,causes device 600 to mark/unmark the media item represented by theenlarged representation as a favorite media), and trash affordance 826 d(e.g., that, when selected, causes device 600 to delete (or initiate aprocess for deleting) the media item represented by the enlarged mediarepresentation).

As illustrated in FIG. 8B, application control region 822 andapplication control region 826 (“the application control regions”) isthe background portion of a region of media viewer user interface 820.At FIG. 8B, the application controls are at the edge of media vieweruser interface 820. Application control region 822 is a header of themedia viewer user interface and application control region 826 is thefooter of media viewer user interface 820.

As illustrated in FIG. 8B, the application control regions include alight-colored (e.g., light gray, a bright color) overlay. Thelight-colored overlay indicates that the device 600 is not operating ina dark mode. In some embodiments, when device 600 is operating in a darkmode, the application control regions include a dark-colored overlay(e.g., dark gray, black), as discussed below in relation to FIGS. 8K-8L.For illustrative purposes, the application control regions includehatching that is indicative of how dark the application control regionsare shaded. For example, an application control region that isillustrated with a higher density of lines (e.g., lines closer to eachother) has a visual appearance that is darker than the visual appearanceof an application control region that is illustrated with a lowerdensity of lines (e.g., lines less close to each other). Thus, thehatching depicted in the application control regions in FIGS. 8B-8K areindicative of the darkness/brightness or color of the corresponding partof media viewer user interface 820.

As illustrated in FIG. 8B, the application control regions are displayedwith a default color (e.g., level of shading of a color), as indicatedby the hatching displayed in FIG. 8B. In FIG. 8B, device 600 isdisplaying the application control regions with a default color (and/ora default level of brightness) because enlarged media representation 824a is representative of a non-HDR media item. At FIG. 8B, device 600detects leftward swipe gesture 850 b in media viewer region 824.

As illustrated in FIG. 8C, in response to detecting leftward swipegesture 850 b, device 600 replaces enlarged media representation 824 awith enlarged media representation 824 b. Enlarged media representation824 b is representative of the same media item as thumbnail mediarepresentation 812 b. Thus, enlarged media representation 812 b isrepresentative of a non-HDR media item (e.g., as discussed above inrelation to thumbnail media representation 812 b in FIG. 8A), which isindicated by the “NON-HDR” label in FIG. 8C. In response to detectingleftward swipe gesture 850 b, device 600 updates thumbnail mediarepresentation 812 to show that the media item that corresponds tothumbnail media representation 812 b is being displayed as the enlargedmedia representation in media viewer region 824.

As illustrated in FIG. 8C, in response to detecting leftward swipegesture 850 b, device 600 continues to display the application controlregions with the default color, as indicated by the hatching displayedin FIG. 8C having the same density as the hatching in FIG. 8B. In FIG.8C, device 600 continues to display the application control regions withthe default color because enlarged media representation 824 a isrepresentative of a non-HDR media item. At FIG. 8C, device 600 detectsleftward swipe gesture 850 c in media viewer region 824.

As illustrated in FIG. 8D, in response to detecting leftward swipegesture 850 c, device 600 replaces enlarged media representation 824 bwith enlarged media representation 824 c. Enlarged media representation824 c is representative of the same media item as thumbnail mediarepresentation 812 c. Thus, enlarged media representation 812 c isrepresentative of an HDR media item (e.g., as discussed above inrelation to thumbnail media representation 812 c in FIG. 8A), which isindicated by the “HDR” label in FIG. 8D. Notably, while thumbnail mediarepresentation 812 c of FIG. 8A did not include visually displayed HDRcontent, enlarged media representation 824 b of FIG. 8D includesvisually displayed HDR content. As illustrated in FIG. 8D, device 600also updates thumbnail media representations 812 to show that thumbnail812 c, using similar techniques and for similar reasons as thosedescribed above (e.g., in FIGS. 8B-8C).

As illustrated in FIG. 8D, in response to detecting leftward swipegesture 850 c, device 600 updates the application control regions tohave a brighter color (e.g., a lighter color, a color with more white)(e.g., as indicated by the hatching of FIG. 8D having a lower level ofdensity as the hatching of FIG. 8C) than the color of applicationcontrol regions in FIG. 8C. In FIG. 8D, device 600 updates theapplication control regions to have the color displayed in FIG. 8D basedon the brightness of HDR content in the respective media item (e.g., themedia item represented by the currently displayed enlarged mediarepresentation).

At FIG. 8E, device 600 continues to display enlarged mediarepresentation 824 c. As the device continues to display enlarged mediarepresentation 824 c (e.g., at FIG. 8E), a determination is made thatenlarged media representation 824 c has been displayed for longer than apredetermined period of time. As illustrated in FIG. 8E, because thedetermination is made that enlarged media representation 824 c has beendisplayed for longer than the predetermined period time, device 600updates the application control regions to have a brighter color (e.g.,as indicated by the hatching of FIG. 8E having a lower level of densityas the hatching of FIG. 8D) than the color of the application controlregions displayed in FIG. 8D. The brighter color of the applicationcontrol regions in FIG. 8D are based on the brightness of HDR content inthe respective media item (e.g., the media item represented by thecurrently displayed enlarged media representation). Thus, at FIG. 8E,device 600 brightens the color of the application control regions basedon the amount of time that enlarged media representation 824 c has beendisplayed. In some embodiments, device 600 does not brighten the colorof the application control regions any further than the color of theapplication control regions displayed in FIG. 8E irrespective of theamount of time that enlarged media representation 824 c is displayed. Insome embodiments, device 600 does not brighten the color of theapplication control regions any further because a determination is madethat the color has reached a maximum level of brightness that is basedon the level of HDR content in the HDR media represented by enlargedmedia representation 824 c. In some embodiments, with reference to FIGS.8C-8E, device 600 displays an animation of the application controlregions gradually brightening from the color of application controlregions of FIG. 8C to the color of application control regions of FIG.8E after enlarged media representation 824 c is displayed.

In some embodiments, device 600 brightens (or darkens) the color of theapplication control regions based on the rate of the gesture (e.g.,swipe gesture 850 c, or the time to transitioning the enlarged mediarepresentation to be displayed) that was received before the enlargedmedia representation was displayed (e.g., in addition, or alternativeto, based on the time that the enlarged media representation wasdisplayed). In some embodiments, device 600 brightens (or darkens) thecolor of the application control regions more when the gesture isdetected for a longer duration of time and brightens (or darkens) thecolor of the application control regions less when the gesture isdetected for a shorter duration of time. In some embodiments, device 600brightness (or darkens) the color of the application control regionsbased on the average rate of the gestures (e.g., gestures 850 b and 850c) that were received before the enlarged media representation wasdisplayed. In some embodiments, device 600 brightens (or darkens) thecolor of the application control regions more when the average rate ofthe gestures is lower and brightens (or darkens) the color of theapplication control regions less when the average rate of the gesturesis higher. At FIG. 8E, device 600 detects tap gesture 850 e on thumbnailrepresentation 812 d.

As illustrated in FIG. 8F, in response to detecting tap gesture 850 e,device 600 replaces enlarged media representation 824 c with enlargedmedia representation 824 d. Enlarged media representation 824 d isrepresentative of the same media item as thumbnail media representation812 d (e.g., an HDR media item), which is indicated by the “HDR” labelin FIG. 8F. In response to detecting tap gesture 850 e, device 600 alsoupdates thumbnail media representation 812 to show that the media itemthat corresponds to thumbnail media representation 812 d is beingdisplayed as the enlarged media representation in media viewer region824. When comparing enlarged media representation 824 c (e.g., in FIGS.8D-8E) and enlarged media representation 824 d (e.g., in FIG. 8F),enlarged media representation 824 d is visually darker than enlargedmedia representation 824 c. At FIG. 8F, a determination is made that themedia item represented by enlarged media representation 824 d includesHDR content that has a second amount of brightness. The second amount ofbrightness of the HDR content in media item represented by enlargedmedia representation 824 d is darker than the amount of brightness ofthe HDR content in the media item represented by enlarged mediarepresentation 824 c of FIGS. 8D-8E.

As illustrated in FIG. 8F, in response to detecting tap gesture 850 eand because the determination is made that the media item represented byenlarged media representation 824 d includes content that has the secondamount of brightness, device 600 updates the color of the applicationcontrol regions. In particular, device 600 updates the color of theapplication control regions, such that the application control regionsof FIG. 8F is darker than the application control regions of FIG. 8E. AtFIG. 8F, device 600 updates the color of the application control regionsof FIG. 8F to be visually darker than the application control regions ofFIG. 8E because the second amount of brightness of the HDR content inthe media item represented by enlarged media representation 824 d (e.g.,shown in FIG. 8F) is darker than the amount of brightness of the HDRcontent in the media item represented by enlarged media representation824 c (e.g., shown in FIG. 8E). Thus, device 600 updates the color ofthe application control regions based on the brightness of the HDRcontent in a media item that is currently displayed (e.g., via enlargedmedia representation) on device 600. In some embodiments, the level ofbrightness of HDR content in the media item is based on a number ofbright portions in the media item, the overall brightness of the mediaitem, the brightest portion of the media item, and/or the brightness ofcertain portions of the media item. In some embodiments, device 600 usesone or more techniques, as discussed above, to determine how much todarken the color of the application control regions. At FIG. 8F, device600 detects leftward swipe gesture 850 f in media viewer region 824.

As illustrated in FIG. 8G, in response to detecting leftward swipegesture 850 f, device 600 replaces enlarged media representation 824 dwith enlarged media representation 824 e. Enlarged media representation824 e is representative of the same media item as thumbnail mediarepresentation 812 e (e.g., an HDR media item), which is indicated bythe “HDR” label in FIG. 8G. In response to detecting leftward swipegesture 850 f, device 600 also updates thumbnail media representation812 to show that the media item that corresponds to thumbnail mediarepresentation 812 e is being displayed as the enlarged mediarepresentation in media viewer region 824. When comparing enlarged mediarepresentation 824 d (e.g., in FIG. 8F) and enlarged mediarepresentation 824 e (e.g., in FIG. 8F), enlarged media representation824 e is visually darker than enlarged media representation 824 d (e.g.,and enlarged media representation 824 c, as described above). At FIG.8G, a determination is made that the media item represented by enlargedmedia representation 824 e includes HDR content that has a third amountof brightness, using one or more techniques discussed above. The thirdamount of brightness of the HDR content in the media item represented byrepresentation 824 e is brighter than the second amount of brightness ofthe HDR content in the media item representation by representation 824d.

As illustrated in FIG. 8G, in response to detecting leftward swipegesture 850 f and because of the determination that the media itemrepresented by enlarged media representation 824 e includes HDR contentthat has the third amount of brightness, device 600 updates the color ofthe application control regions. At FIG. 8G, device 600 updates thecolor of the application control regions, such that the applicationcontrol regions of FIG. 8G is brighter than the application controlregions of FIGS. 8E-8D (e.g., because the third amount of brightness(e.g., FIG. 8G) is greater than the second amount of brightness (e.g.,FIG. 8D)). Device 600 updates the color of application regions of FIG.8G, using one or more techniques, as discussed above. At FIG. 8G, device600 detects leftward swipe gesture 850 g in media viewer region 824.

FIGS. 8H-8I illustrate media viewer user interface 820 that can bedisplayed in response to device 600 detecting leftward swipe gesture 850g. In some embodiments, media viewer user interface 820 of FIG. 8H isdisplayed in response to device 600 detecting leftward swipe gesture 850g, and media viewer user interface 820 of FIG. 8I is displayed after themedia viewer user interface 820 is displayed for a predetermined periodof time (e.g., using techniques discussed above in relation to FIGS.8D-8E). In some embodiments, media viewer user interface 820 of FIG. 8His not displayed in response to detecting leftward swipe gesture 850 g,and media viewer user interface 820 of FIG. 8I is displayed in responseto detecting leftward swipe gesture 850 g.

As illustrated in FIG. 8H (and FIG. 8I), in response to detecting tapgesture 850 g, device 600 replaces enlarged media representation 824 ewith enlarged media representation 824 f. Enlarged media representation824 f is representative of the same media item as thumbnail mediarepresentation 812 f (e.g., an HDR media item), which is indicated bythe “HDR” label in FIG. 8H (and FIG. 8I). In response to detecting tapgesture 850 g, device 600 also updates thumbnail media representation812 to show that the media item that corresponds to thumbnail mediarepresentation 812 f is being displayed as the enlarged mediarepresentation in media viewer region 824. When comparing enlarged mediarepresentation 824 e (e.g., in FIG. 8G) and enlarged mediarepresentation 824 f (e.g., in FIG. 8H), enlarged media representation824 f is visually brighter than enlarged media representation 824 e. AtFIG. 8H (or FIG. 8I), a determination is made that the media itemrepresented by enlarged media representation 824 f has HDR content thatexceeds a brightness threshold.

As illustrated in FIG. 8I, because the determination is made that themedia item (e.g., represented by enlarged media representation 824 f)exceeds the brightness threshold (e.g., and in response to detectingswipe gesture 850 g), device 600 darkens the HDR content of enlargedmedia representation 824 f (as shown by enlarged media representation824 f of FIG. 8I having lines that are darker than the lines of enlargedmedia representation 824 f of FIG. 8H). In addition, device 600 updatesthe color of the application control regions, such that the applicationcontrol regions of FIG. 8I is brighter than the application controlregions of FIG. 8G. Device 600 updates the color of application regionsof FIG. 8I, using one or more techniques, as discussed above. Thus, atFIG. 8I, when a determination is made that a media item exceeds abrightness threshold, device 600 modifies both the enlarged mediarepresentation of the media item and the application control regions,such that the brightness of the enlarged media representation is closerto the brightness of the application control regions. In someembodiments, device 600 displays a less visually distracting media userinterface by displaying an application control region that has abrightness that is closer to the brightness of the enlargedrepresentation. At FIG. 8I, device 600 detects leftward swipe gesture850 i in media viewer region 824.

As illustrated in FIG. 8J, in response to detecting leftward swipegesture 850 i, device 600 replaces enlarged media representation 824 fwith enlarged media representation 824 g. Enlarged media representation824 g is representative of the same media item as thumbnail mediarepresentation 812 g (e.g., a non-HDR media item), which is indicated bythe “NON-HDR” label in FIG. 8J. As illustrated in FIG. 8J, in responseto detecting leftward swipe gesture 850 i and because the respectivemedia item is a non-HDR media item, device 600 updates the color ofapplication control region to be the default color (e.g., by thehatching displayed in FIG. 8J having the same density as the hatching inFIG. 8B).

FIGS. 8K-8L illustrate device 600 operating in a dark mode and/oroperating while displaying a dark-colored overlay in the applicationregions. As illustrated in FIG. 8K, device 600 displays the applicationcontrol regions with a dark-colored overlay (e.g., dark gray, black;non-translucent) and enlarged media representation 824 b displayed inmedia viewer region 824. At FIG. 8K, device 600 detects leftward swipegesture 850 k in media viewer region 824.

As illustrated in FIG. 8L, in response to detecting leftward swipegesture 850 k, device 600 replaces enlarged media representation 824 bwith enlarged media representation 824 c. Enlarged media representation824 c is representative of the same media item as thumbnail mediarepresentation 812 c. Thus, enlarged media representation 812 c isrepresentative of an HDR media item (e.g., as discussed above inrelation to thumbnail media representation 812 c in FIG. 8A), which isindicated by the “HDR” label in FIG. 8D. As illustrated in FIG. 8K,device 600 continues to display the application control regions with thesame visual appearance as the application control regions were displayedin FIG. 8K, although enlarged media representation 812 c isrepresentative of an HDR media item. Thus, when device 600 displays theapplication regions with the dark-colored overly, device 600 does notupdate the visual appearance of the application control regions based onthe brightness of the HDR content in the media item (e.g., as opposed towhen device 600 updates the visual appearance of the application controlregions in FIGS. 8C-8D when device 600 displayed the application controlregion with the light-colored overlay).

FIG. 9 is a flow diagram illustrating a method for displaying mediausing a computer system in accordance with some embodiments. Method 900is performed at a computer system (e.g., 100, 300, 500, 600) that is incommunication with a display generation component (e.g., a displaycontroller, a touch-sensitive display system) and one or more inputdevices (e.g., a touch-sensitive surface). Some operations in method 900are, optionally, combined, the orders of some operations are,optionally, changed, and some operations are, optionally, omitted.

As described below, method 900 provides an intuitive way for displayingmedia. The method reduces the cognitive burden on a user for displayingmedia, thereby creating a more efficient human-machine interface. Forbattery-operated computing systems, enabling a user to view media fasterand more efficiently conserves power and increases the time betweenbattery charges.

The computer system (e.g., 600) (e.g., a smartphone, a smartwatch)displays (902), via the display generation component, a media vieweruser interface (e.g., 820) (e.g., an interface for displaying one ormore representations (e.g., enlarged representations or non-thumbnailrepresentations) of previously captured media) that includes: a firstportion (e.g., 824) that includes a representation (e.g., 824 a-824 f)of a first previously captured media item (e.g., an image, a video); anda second portion (e.g., 822 and/or 826) (e.g., the chrome portion (e.g.,a header, a footer, a menu section of the user interface) of the userinterface, the portion of the user interface that partially or fullysurrounds the visual content (e.g., first portion) of the userinterface) that has a first visual appearance and that is different(e.g., distinct, independent) from the first portion (e.g., 824) of themedia viewer user interface (e.g., 820). In some embodiments, therepresentation of the previously captured media has been captured by oneor more cameras of the computer system. In some embodiments, the firstpreviously captured media is high-dynamic-range (HDR) media. In someembodiments, the first previously captured media is nothigh-dynamic-range media. In some embodiments, the second portion of themedia viewer user interface is outside of the first portion of the mediaviewer user interface. In some embodiments, the second portion of themedia viewer user interface is above and/or below the first portion ofthe media viewer user interface. In some embodiments, the second portionincludes a third portion of the media user interface and a fourthportion of the media user interface that are separated by the firstportion of the media user interface. In some embodiments, the secondportion includes a plurality of affordances (e.g., an affordance that,when selected, causes the computer system to share a representation ofthe previously captured media via one or more applications, anaffordance that, when selected, causes the computer system to display auser interface for editing a representation of the previously capturedmedia, an affordance that, when selected, causes the computer system todelete the displayed representation of the previously captured media, anaffordance that, when selective, causes the computer system to include arepresentation of the previously captured media in a particular group ofrepresentations (e.g., favorite representations, “liked”representations, etc.), an affordance that, when selected, causes thecomputer system to concurrently show a plurality of representations(e.g., a media gallery with a plurality of photos in a grid), and anaffordances that, when selected, causes the computer system to cease todisplay the media viewer user interface and to display a user interfacethat is different from the media viewer user interface). In someembodiments, the representation of the previously captured media hasbeen captured by one or more cameras of the computer system. In someembodiments, the first previously captured media is high-dynamic-rangemedia. In some embodiments, the first previously captured media is nothigh-dynamic-range media.

While displaying, via the display generation component, the media vieweruser interface that includes the second portion (e.g., 822 and/or 826)of the media viewer user interface (e.g., 820) (e.g., 820) that has thefirst visual appearance (e.g., 822 and/or 826 in FIG. 8F) (and the firstportion that includes a representation of a first previously capturedmedia item), the computer system receives (904) (e.g., 850 f) a request(e.g., a swipe gesture on the media viewer user interface (e.g., 820))to display a representation (e.g., 824 e) of a second previouslycaptured media item (e.g., still images, video) that is different fromthe first previously captured media item (e.g., 824 d) (e.g., to replacedisplay of the representation of the first previously captured mediaitem with the representation of the second previously captured mediaitem).

In response to (906) receiving the request to display the representationof the second previously captured media item and in accordance with(908) a determination that a first set of criteria is met, where thefirst set of criteria includes a criterion that is met when therepresentation of the second previously captured media item (e.g., 824e) (or a different media item) is a high-dynamic-range (HDR) media item,the computer system displays (910) the representation of the secondpreviously captured media item (e.g., replacing display of therepresentation of the first previously captured media item with arepresentation of a second previously captured media item) and updates(912) the second portion (e.g., 822 and/or 826) of the media viewer userinterface (e.g., 820) to have a second visual appearance (e.g., 822and/or 826 in FIG. 8G) that is different from the first visualappearance (e.g., 822 and/or 826 in FIG. 8F). In some embodiments, inaccordance with a determination that a first set of criteria is met, thefirst previously captured media item ceases to be displayed. In someembodiments, the second visual appearance is more/less bright (or white)than the first visual appearance. In some embodiments, the second visualappearance is based on the level of brightness of the representation ofthe second previously captured media item. In some embodiments, thelevel of brightness can include the respective brightness of certainelements in a representation of previously captured media and/or can bebased on a number of bright elements in a representation of previouslycaptured media, and/or can be based on overall brightness of arepresentation of previously captured media. Updating a portion of themedia viewer user interface (e.g., 820) (e.g., a border of an image, achrome) when prescribed conditions are met (e.g., when displaying an HDRphoto) makes the user interface less visually distracting when HDRphotos are displayed because the portion of media portion that isupdated more closely matches elements in the HDR photo. Performing anoperation when a set of conditions has been met without requiringfurther user input enhances the operability of the system and makes theuser-system interface more efficient (e.g., by helping the user toprovide proper inputs and reducing user mistakes whenoperating/interacting with the system) which, additionally, reducespower usage and improves battery life of the system by enabling the userto use the system more quickly and efficiently.

In some embodiments, as a part of updating the second portion (e.g., 822and 826) of the media viewer user interface (e.g., 820) to have thesecond visual appearance that is different from the first visualappearance and in accordance with a determination that a portion of themedia item (e.g., 824 d in FIG. 8F) (e.g., HDR content) has a firstlevel of brightness, the computer system displays the second portion(e.g., 822 and/or 826 in FIG. 8F) of the media viewer user interface(e.g., 820) with a first amount of a visual characteristic (e.g., levelof brightness, opacity, color (e.g., whiteness)). In some embodiments,as a part of updating the second portion of the media viewer userinterface (e.g., 820) to have the second visual appearance that isdifferent from the first visual appearance and in accordance with adetermination that the portion of the media item has a second level ofbrightness (e.g., 824 e in FIG. 8G) that is different from the firstlevel of brightness, the computer system displays the second portion(e.g., 822 and/or 826 in FIG. 8G) of the media viewer user interface(e.g., 820) with a second amount of the visual characteristic (e.g.,level of brightness, opacity, color (e.g., whiteness)) that is differentfrom the first amount of the visual characteristic. In some embodiments,the second portion of the media viewer user interface is updated to havethe second visual appearance based on a brightness of content (e.g., HDRcontent) in the media item. In some embodiments, when the second levelof brightness is higher (or, alternatively, lower) than the first levelof brightness, the second amount is higher than the first amount. Insome embodiments, when the media item is HDR content and portion of themedia item is configured to be displayed with a brightness above thefirst level of brightness, the second portion of the media viewer userinterface is displayed with a first amount of a visual characteristic;and when the media item is HDR content and no portion of the media itemis configured to be displayed with a brightness above the first level ofbrightness, the second portion of the media viewer user interface isdisplayed with a second amount of the visual characteristic (e.g., levelof brightness, opacity, color (e.g., whiteness)) that is different fromthe first amount of the visual characteristic. Dynamically updating aportion of the media viewer user interface (e.g., a chrome) differentlybased on the brightness of HDR content for different media items makesthe user interface less visually distracting when displaying arespective media item (e.g., when the HDR content of the media isbrighter, the portion of the media viewer user interface is brighter).Performing an operation when a set of conditions has been met withoutrequiring further user input enhances the operability of the system andmakes the user-system interface more efficient (e.g., by helping theuser to provide proper inputs and reducing user mistakes whenoperating/interacting with the system) which, additionally, reducespower usage and improves battery life of the system by enabling the userto use the system more quickly and efficiently.

In some embodiments, as a part of updating the second portion of themedia viewer user interface (e.g., 820) to have the second visualappearance that is different from the first visual appearances and inaccordance with a determination that the media item (e.g., 824 c) hasbeen displayed for a first amount of time, the computer system displaysthe second portion (e.g., 822 and/or 826 in FIG. 8D) of the media vieweruser interface (e.g., 820) with a third amount of a visualcharacteristic (e.g., level of brightness, opacity, color (e.g.,whiteness)). In some embodiments, as a part of updating the secondportion of the media viewer user interface (e.g., 820) to have thesecond visual appearance that is different from the first visualappearance and in accordance with a determination that the media item(e.g., 824 c) has been displayed for a second amount of time that isdifferent from the first amount of time, the computer system displaysthe second portion (e.g., 822 and/or 826 in FIG. 8E) of the media vieweruser interface (e.g., 820) with a fourth amount of the visualcharacteristic (e.g., level of brightness, opacity, color (e.g.,whiteness)) that is different from the third amount of the visualcharacteristic. In some embodiments, the second portion of the mediaviewer user interface is updated to have the second visual appearancebased on an amount of time that the media item has been displayed. Insome embodiments, while displaying the media item, the visual appearanceof the second portion can change (e.g., gradually, multiple times) overa period time (e.g., over a period of 0.5, 1, 2, 5, or 10 seconds, thenoptionally stops changing while the same media item continues to bedisplayed). In some embodiments, when the media item is displayed forthe second amount of time that is longer (or, alternatively, shorter)than the first amount of time, the fourth amount of the visualcharacteristic is higher than the third amount of the visualcharacteristic. In some embodiments, the second portion of the mediaviewer user interface is displayed with an amount (or degree) of thevisual characteristic, wherein the amount of the visual characteristicis based on an amount of elapsed time (e.g., amount of time that thefirst previously captured media item was displayed, amount of time thatthe second previously captured media item has been displayed).Dynamically updating a portion of the media viewer user interface (e.g.,a chrome) differently based on the time that the HDR media is displayedmakes the user interface less visually distracting (e.g., changes lesswhen the media is displayed for less time) when displaying media andreduces the amount of different levels of brightness to which theportion of the media viewer user interface is updated. Performing anoperation when a set of conditions has been met without requiringfurther user input enhances the operability of the system and makes theuser-system interface more efficient (e.g., by helping the user toprovide proper inputs and reducing user mistakes whenoperating/interacting with the system) which, additionally, reducespower usage and improves battery life of the system by enabling the userto use the system more quickly and efficiently.

In some embodiments, as a part of displaying the representation of thesecond previously captured media item (e.g., 824 c-824 f), the computersystem replaces the representation of the first previously capturedmedia item with the representation of the second previously capturedmedia. In some embodiments, as a part of updating the second portion ofthe media viewer user interface to have the second visual appearancethat is different from the first visual appearance and in accordancewith a determination that the representation of the first previouslycaptured media item was displayed for at least a first amount of timebefore being replaced with the representation of the second previouslycaptured media, the computer system displays the second portion of themedia viewer user interface (e.g., 820) with a fifth amount of a visualcharacteristic (e.g., level of brightness, opacity, color (e.g.,whiteness)). In some embodiments, as a part of updating the secondportion of the media viewer user interface (e.g., 820) to have thesecond visual appearance that is different from the first visualappearance and in accordance with a determination that therepresentation of the first previously captured media item has beenreplaced with the representation of the second previously captured mediain a second amount of time that is different from the first amount oftime, the computer system displays the second portion of the mediaviewer user interface (e.g., 820) with a sixth amount of the visualcharacteristic (e.g., level of brightness, opacity, color (e.g.,whiteness)) that is different from the fifth amount of the visualcharacteristic. In some embodiments, the second portion of the mediaviewer user interface is updated to have the second visual appearancebased on the duration of transitioning between previously displayedrepresentations. In some embodiments, when the duration of transitioningbetween representations is smaller (bigger), the amount of change in thevisual appearance is smaller (bigger). Dynamically updating a portion ofthe media viewer user interface (e.g., a border, a chrome) differentlybased on the time of transitioning between two media items makes theuser interface less visually distracting (e.g., change less when themedia is transitioned quicker) when displaying media and reduces theabruptness in the change in the amount of brightness when quicklytransitioning between media. Performing an operation when a set ofconditions has been met without requiring further user input enhancesthe operability of the system and makes the user-system interface moreefficient (e.g., by helping the user to provide proper inputs andreducing user mistakes when operating/interacting with the system)which, additionally, reduces power usage and improves battery life ofthe system by enabling the user to use the system more quickly andefficiently.

In some embodiments, as a part of updating the second portion of themedia viewer user interface (e.g., 820) to have the second visualappearance that is different from the first visual appearance and inaccordance with a determination that an average rate of requests (e.g.,850 f, 850 g) (e.g., the previous 5 requests) to display previouslycaptured media items is below a first threshold (e.g., or a first numberof a plurality of request to display a plurality of representations ofthe previously captured media items were received within a predeterminedtime before displaying the representation of the second previouslycaptured media item), the computer system displays the second portion ofthe media viewer user interface (e.g., 820) with a seventh amount of avisual characteristic (e.g., level of brightness, opacity, color (e.g.,whiteness)). In some embodiments, as a part of updating the secondportion of the media viewer user interface (e.g., 820) to have thesecond visual appearance that is different from the first visualappearance and in accordance with a determination that an average rateof requests to display previously captured media items is not below thefirst threshold (e.g., a second number of a plurality of request todisplay a plurality of representations of the previously captured mediaitems were received within a predetermined time before displaying therepresentation of the second previously captured media item), thecomputer system displays the second portion of the media viewer userinterface (e.g., 820) with an eighth amount of the visual characteristic(e.g., level of brightness, opacity, color (e.g., whiteness)) that isdifferent from the seventh amount of the visual characteristic. In someembodiments, the second number is different from the first number. Insome embodiments, the second portion of the media viewer user interfaceis updated to have the second visual appearance based the average rateof inputs (e.g., swipe rate or speed). In some embodiments, when theaverage rate of inputs is higher, the second portion changes less thanwhen the average rate of subsequent inputs is lower. In someembodiments, the second portion of the media viewer user interface isdisplayed with an amount (or degree) of the visual characteristic,wherein the amount of the visual characteristic is based on the rate atwhich content has been displayed (e.g., number of images per unit oftime) in the first portion of the media browser interface. Dynamicallyupdating a portion of the media viewer user interface (e.g., a border, achrome) differently based on rate of transitioning between media itemsmakes the user interface less visually distracting (e.g., change lesswhen the rate is quicker) when displaying media and reduces theabruptness in the change in the amount of brightness when quicklytransitioning between media. Performing an operation when a set ofconditions has been met without requiring further user input enhancesthe operability of the system and makes the user-system interface moreefficient (e.g., by helping the user to provide proper inputs andreducing user mistakes when operating/interacting with the system)which, additionally, reduces power usage and improves battery life ofthe system by enabling the user to use the system more quickly andefficiently.

In some embodiments, while displaying, via the display generationcomponent, the media viewer user interface that includes the secondportion of the media viewer user interface (e.g., 820) that has thefirst visual appearance (and the first portion that includes arepresentation of a first previously captured media item), the computersystem receives a request to display a representation of a thirdpreviously captured media item that is different from the firstpreviously captured media item and the second previously captured mediaitem. In some embodiments, in response receiving the request to displaythe representation of the third previously captured media item and inaccordance with a determination that the first set of criteria is met,the computer displays the representation of the third previouslycaptured media item (e.g., by replacing the representation of the secondpreviously captured media item) and updates the second portion (e.g.,822 and/or 826) of the media viewer user interface (e.g., 820) to have athird visual appearance that is different from the first visualappearance and the second visual appearance. In some embodiments, thefirst set of criteria includes a criterion that is met when therepresentation of the third previously media is an HDR media item. Insome embodiments, when the third media item has a higher level ofbrightness (e.g., level of brightness may include the respectivebrightness of certain elements in image that can be based on a number ofbright elements in image, and/or can be based on overall brightness ofimage) content than the previously displayed media item, the secondportion (e.g., 822 and/or 826) of the media viewer user interface (e.g.,820) is brighter (or has more white) while the third media item isdisplayed than when the previous media item was displayed. Dynamicallyupdating a portion of the media viewer user interface (e.g., a chrome)differently based on the brightness of HDR content for different mediaitems makes the user interface less visually distracting when displayinga respective media item (e.g., as HDR content of the media is brighter,the portion of the media viewer user interface gets brighter).Performing an operation when a set of conditions has been met withoutrequiring further user input enhances the operability of the system andmakes the user-system interface more efficient (e.g., by helping theuser to provide proper inputs and reducing user mistakes whenoperating/interacting with the system) which, additionally, reducespower usage and improves battery life of the system by enabling the userto use the system more quickly and efficiently.

In some embodiments, the second previously captured media item is an HDRmedia item (e.g., 824 c-824 f). In some embodiments, the representationof the second previously captured media item is displayed with HDR. Insome embodiments, for a media item (e.g., an image or video) that has atleast a portion that is intended to be displayed with a particularbrightness level that is above the standard dynamic range forbrightness, the representation of the media item is displayed with abrightness level (e.g., the particular brightness level) that is abovethe standard dynamic range.

In some embodiments, the first set of criteria includes a criterion thatis met when the second portion (e.g., 822 and/or 826) is (or within athreshold value (e.g., an red-blue-green value, a hex value)) a firstcolor (e.g., a color (e.g., white or light colored) that is not a secondcolor (e.g., black or dark colored), a bright color (e.g., a color withmore white than black)). In some embodiments, the first set of criteriaincludes a criterion that is met when the second portion (e.g., 822and/or 826) is not a second color (e.g., black or dark colored). In someembodiments, the computer system receives a user input selecting amongtwo or more options for color range of the second portion (e.g., 822and/or 826), and the first set of criteria includes a criterion that ismet when the current color range selection for the second portion (e.g.,822 and/or 826) is a first color range (and not a second color or secondcolor range).

In some embodiments, as a part of updating the second portion (e.g., 822and/or 826) of the media viewer user interface to have the second visualappearance, the computer system displays an animation that gradually(e.g., fading over a period of time (e.g., 1, 2, 3 seconds)) transitionsthe second portion (e.g., 822 and/or 826) of the media viewer userinterface from having the first visual appearance to the second visualappearance. Dynamically updating a portion of the media viewer userinterface (e.g., a chrome) gradually when an HDR media item is displayedmakes the user interface less visually distracting when display the HDRmedia item and reduces the abruptness of the change in the portion ofthe media view interface. Providing improved visual feedback to the userenhances the operability of the system and makes the user-systeminterface more efficient (e.g., by helping the user to provide properinputs and reducing user mistakes when operating/interacting with thesystem) which, additionally, reduces power usage and improves batterylife of the system by enabling the user to use the system more quicklyand efficiently.

In some embodiments, the representation of the previously captured mediaitem (e.g., first previously captured media item, second previouslycaptured media item, etc.) includes an amount of brightness (e.g.,average brightness, percentage of bright areas). In some embodiments,the representation of the previously captured media item is displayedwith, in accordance with a determination that the amount of brightness(e.g., average brightness, percentage of bright areas) exceeds abrightness threshold, a modified amount (e.g., reduced) of brightness(e.g., reduced average brightness, reduced brightness in some portionswhile maintaining brightness of other portions, reduced brightnessequally across the image). In some embodiments, the representation ofthe previously captured media item is displayed with, in accordance witha determination that the amount of brightness does not exceed thebrightness threshold, the amount of brightness (e.g., without reducingthe average brightness, without reducing brightness equally across theimage). In some embodiments, the underlying content of the media itemremains the same (e.g., has the amount of brightness that exceeds thebrightness threshold), but the media item is displayed with the modified(e.g., reduced) amount of brightness. Dynamically changing the displayedHDR media item differently based on the brightness of HDR content fordifferent media items makes the user interface less visually distractingwhen displaying a respective media item (e.g., as HDR content of thephoto is brighter, the photo is displayed darker reduce the visualdifferent between the chrome and the photo). Performing an operationwhen a set of conditions has been met without requiring further userinput enhances the operability of the system and makes the user-systeminterface more efficient (e.g., by helping the user to provide properinputs and reducing user mistakes when operating/interacting with thesystem) which, additionally, reduces power usage and improves batterylife of the system by enabling the user to use the system more quicklyand efficiently.

In some embodiments, the first previously captured media item (e.g., 824a-824 b, 824 g) is not the HDR media item. In some embodiments, thesecond previously captured media item (e.g., 824 c-824 f) is the HDRmedia item. In some embodiments, before displaying, via the displaygeneration component, the media viewer user interface that includes thefirst portion and the second portion (e.g., 822 and/or 826), thecomputer system displays, via the display generation component, a userinterface (e.g., 810) that includes a plurality of representations(e.g., 812 a-812 g) of media items. In some embodiments, the pluralityof representations of media items includes display of a secondrepresentation (e.g., 812 a-812 b, 812 g) (e.g., a thumbnail) of thefirst previously captured media item without HDR content and a secondrepresentation (e.g., 812 c-812 f) (e.g., a thumbnail) of the secondpreviously captured media item without HDR content. In some embodiments,thumbnails of media items (e.g., images) are displayed using thestandard dynamic range brightness, regardless of whether the media itemsare intended to be displayed with a particular brightness level that isabove the standard dynamic range for brightness. In some embodiments,while displaying the plurality of representations of media items, thecomputer system receives a request to display the first (or,alternatively, second or any of the other plurality of representations)previously captured media item (e.g., a selection of (e.g., a tap on)the second representation of the first (or, alternatively, second or anyof the other plurality of representations) previously captured mediaitem) and, in response to receiving the request to display the firstrepresentation (or, alternatively, second or any of the other pluralityof representations), the electronic displays the media interface whichincludes the first portion (e.g., having the representation of the first((or, alternatively, second or any of the other plurality ofrepresentations) previously captured media item) previously capturedmedia item) and the second portion (e.g., 822 and/or 826) (e.g., withthe first visual appearance (or, alternatively, the second visualappearance when the second previously captured media item is displayedin the first portion)).

In some embodiments, in response to (906) receiving the request todisplay the representation of the second previously captured media itemand in accordance with a determination that the first set of criteria isnot met, the computer system forgoes (914) updating the second portion(e.g., 822 and/or 826) of the media viewer user interface (e.g., 820) tohave the second visual appearance that is different from the firstvisual appearance (e.g., displaying (or continuing to display) thesecond portion (e.g., 822 and/or 826) of the media viewer user interface(e.g., 820) with the first visual appearance). In some embodiments, thefirst set of criteria is not met when the representation of the secondpreviously captured media item is not an HDR media item. In someembodiments, the chrome (area surrounding images displayed) does notchange when a non-HDR photo is displayed. In some embodiments, inaccordance with a determination that the first set of criteria is notmet, the computer system transitions display of the second portion(e.g., 822 and/or 826) to a predefined (e.g., independent of thebrightness of the second previously captured media item) visualappearance. Thus, as long as the image is not an HDR image, the secondportion (e.g., 822 and/or 826) is displaying using the predefinedappearance, regardless of the amount of brightness/darkness of thenon-HDR image. Dynamically forgoing the change of the portion of themedia user interface when the media is not HDR media makes the userinterface less visually distracting when displaying the non-HDRrespective media item. Performing an operation when a set of conditionshas been met without requiring further user input enhances theoperability of the system and makes the user-system interface moreefficient (e.g., by helping the user to provide proper inputs andreducing user mistakes when operating/interacting with the system)which, additionally, reduces power usage and improves battery life ofthe system by enabling the user to use the system more quickly andefficiently.

In some embodiments, while displaying the representation of the secondpreviously captured media item and the second portion (e.g., 822 and/or826) has the second visual appearance, the computer system receives(e.g., 850 g, 850 i) a request to display the representation of a fourthpreviously captured media item. In some embodiments, in response toreceiving (e.g., 850 g, 850 i) the request to display the thirdpreviously captured media item and in accordance with a determinationthat the first set of criteria is met, the computer system displays therepresentation of the fourth previously captured media item (e.g., byreplacing display of the second previously captured media item) withoutupdating the visual appearance of the second portion (e.g., 822 and/or826) and updates the second portion (e.g., 822 and/or 826) of the mediato have a visual appearance (e.g., 822 and/or 826 in FIGS. 8E-8I) thatis different from the first visual appearance and the second visualappearance. In some embodiments, in response to receiving the request todisplay the third previously captured media item and in accordance witha determination that the first set of criteria is not met (e.g., thefourth previously captured media item is not an HDR media item) thecomputer system displays the representation of the fourth previouslycaptured media item and updates the second portion (e.g., 822 and/or826) of the media to have a predefined (e.g., independent of thebrightness of the second previously captured media item) visualappearance (e.g., 822 and/or 826 in FIGS. 8C-8D and 8J) that isdifferent from the second visual appearance. In some embodiments, aslong as the fourth previously captured media item is not HDR, the secondportion (e.g., 822 and/or 826) is displaying using the predefined visualappearance, regardless of how bright/dark the non-HDR image is. In someembodiments, when a non-HDR image is requested to be displayed, thesecond portion (e.g., 822 and/or 826) is displayed using a predefinedvisual appearance (e.g., the same color and/or brightness for allnon-HDR images), regardless of how bright/dark the non-HDR image is; andwhen an HDR image is requested to be displayed, the second portion(e.g., 822 and/or 826) is displayed using a variable visual appearancethat is based on how bright/dark the HDR image is.

Note that details of the processes described above with respect tomethod 900 (e.g., FIG. 9) are also applicable in an analogous manner tothe methods described below/above. For example, methods 700 and 1100optionally includes one or more of the characteristics of the variousmethods described above with reference to method 900. For example,method 900 can display media that has been captured using a computersystem that is configured to capture media with a particular exposurecompensation value using one or more steps of method 700 (discussedabove). For brevity, these details are not repeated below.

FIGS. 10A-10AC illustrate exemplary user interfaces for displaying astatus indicator using an electronic device in accordance with someembodiments. The user interfaces in these figures are used to illustratethe processes described below, including the processes in FIG. 11.

In FIGS. 10A-10AC, device 600 can record (or capture) media using one ormore media-capturing devices, such as a microphone (e.g., at FIGS. 10B,10E) and/or a camera (e.g., at FIGS. 10Q, 10W). FIGS. 10A-10ACillustrate exemplary scenarios where device 600 displays or does notdisplay a recording status indicator based on the type of data that isbeing recorded by at least one of the media-capturing devices. As usedin relation to FIGS. 10A-10C, the type of data refers to how the datawill be used (e.g., whether the data is available for playback; whetherthe data is passed to a trusted application or a non-trustedapplication) and not the format of the data. As used herein in relationto FIGS. 10A-10AC, a first type of data (e.g., the type of data forwhich a capture status indicator is displayed) refers to data that isdetermined to be used (or potentially used) in a first manner, and asecond type of data (e.g., the type of data for which a capture statusindicator is not displayed) refers to data that is determined not to beused in the first manner. In some embodiments, the first type of data(e.g., the type of data for which a capture status indicator isdisplayed) corresponds to data that is available for (e.g., stored)later playback and the second type of data (e.g., the type of data forwhich a capture status indicator is not displayed) corresponds to datathat is not available for playback. In some embodiments, the first typeof data (e.g., the type of data for which a capture status indicator isdisplayed) corresponds to data that is passed to a non-trustedapplication (e.g., a non-first-party voice-assistant application, anon-first-party authentication application) and the second type of data(e.g., the type of data for which a capture status indicator is notdisplayed) corresponds to data that is used to control various featuresof the device by one or more trusted applications (e.g., components ofthe operating system or trusted first-party and/or third-partyapplications) without being passed to a non-trusted application (e.g., anon-first-party voice-assistant application, a non-first-partyauthentication application) and without being retained as media that canbe played back at a later time (e.g., either by the device or by anotherdevice). Thus, the determination is based on whether or not anon-trusted application has access to the recorded data (e.g., audio orvideo content). In some embodiments, the recording status indicator isdisplayed independent of whether an indicator of recording is displayedby the application that is recording the data.

FIG. 10A illustrates device 600 displaying a user interface with icons690. At FIG. 10A, device 600 detects voice input 1050 a (e.g., “HeyAssistant”) via a microphone of device 600. As illustrated in FIG. 10B,in response to detecting voice input 1050 a, device 600 displays userinterface 1004. User interface 1004 is a user interface for a voiceassistant application. User interface 1004 includes the phrase “WHAT CANI HELP YOU WITH,” which indicates that device 600 is waiting to receivevoice input corresponding to a command.

Notably, at FIGS. 10A-10B, device 600 is recording data, via themicrophone of device 600, in order to identify commands (e.g., that areuttered by a user of device 600). However, at FIGS. 10A-10B, device 600does not display a recording status indicator (e.g., recording statusindicator 1042 as illustrated in FIG. 10E) because a determination ismade that device 600 is not recording the first type of data. In FIGS.10A-10B, device 600 is not recording the first type of data because thedata that is being recorded is determined to be data that will not beavailable for later playback. In particular, the data being recording atFIGS. 10A-10B is being passed to a trusted application and is notavailable for later playback because device 600 is recording the data toidentify voice commands that will allow a native assistant (or trusted)voice application to cause device 600 to perform one or more operations(e.g., provide directions to a location, provide an answer to a queryfrom a user).

At some point in time after displaying user interface 1010, device 600re-displays the user interface with application icons 690, includingvoice memos application icon 690 b. At FIG. 10C, device 600 detects tapgesture 1050 c on voice memos application icon 690 b. As illustrated inFIG. 10D, in response to detecting tap gesture 1050 c, device 600launches a voice memos application that corresponds to voice memoapplication icon 690 b and displays a recording initiation userinterface (e.g., for the voice memos application) that includes audiorecording affordance 1010. Because a determination is made that data ofthe first type is not being recorded, device 600 does not displayrecording status indicator 1042 at FIG. 10C. At FIG. 10D, device 600detects tap gesture 1050 d on audio recording affordance 1010.

As illustrated in FIG. 10E, in response to detecting tap gesture 1050 d,device 600 displays an audio recording user interface that includes stopaffordance 1016, which indicates that device 600 is recording data(e.g., audio recording affordance 1010 has ceased to be displayed). AtFIG. 10E, in response to detecting tap gesture 1050 d, device 600 causesone or more of microphones of device 600 to record data (e.g., audiodata). The data recorded at FIG. 10E (e.g., in response to detecting tapgesture 1050 d) is data that is being recorded for the voice memosapplication (e.g., can be accessed by the voice memos application and/orwas initiated by the voice memos application). At FIG. 10E, adetermination is made that the data being recorded for the voice memosapplication is the first type of data. The data being recorded for thevoice memos application is determined to be the first type of databecause a determination is made that the data is being recorded to beavailable for later playback.

As illustrated in FIG. 10E, because the determination is made that thedata being recorded for the voice memos application is the first type ofdata, device 600 displays recording status indicator 1042 at a locationof cellular signal status indicator 820 a. Thus, in some embodiments,recording status indicator 1042 indicates to a user that one or moremedia-capturing devices (e.g., a microphone, a camera) of device 600 isrecording the first type of data, such that a user can stop device 600from recording the data if desired. In some embodiments, the user mayotherwise be unaware that the first type of data is being recorded, suchas if the application initiating the recording does not provide anappropriate indication. Thus, in some embodiments, displaying recordingstatus indicator 1042 can provide the user with information that isrelevant to the user's privacy (e.g., whether the user's voice or aphoto or image of the user is recorded and available for later playbackon one or more devices). While continuing to record the first type ofdata for the voice memos application, device 600 receives an indicationof an incoming call via a web-calling application.

As illustrated in FIG. 10F, in response to receiving the indication ofthe incoming call, device 600 displays a web-calling user interface thatincludes accept affordance 1032 and an indication that the incoming callis being received from an external device associated with “John.” Asillustrated in FIG. 10F, device 600 continues to display recordingstatus indicator 1042 while displaying the web-calling user interface.Device 600 continues to display recording status indicator 1042 becausedevice 600 is continuing to record audio data for the voice memosapplication, as discussed above in relation to FIG. 10E (e.g., the audiorecording was not stopped in FIGS. 10E-10F). At FIG. 10F, device 600detects tap gesture 1050 f on accept affordance 1032.

As illustrated in FIG. 10G, in response to detecting tap gesture 1050 f,device 600 causes the incoming call to be answered and displays a userinterface with end affordance 1034. At FIG. 10G, after the incoming callis answered, device 600 causes a microphone (e.g., the same or differentmicrophone than the microphone that is currently recording data for thevoice memos application) of device 600 to record data for theweb-calling application. At FIG. 10G, device 600 is concurrently (e.g.,via a microphone of device 600) recording data for the voice memosapplication and data for the web-calling application. At FIG. 10G,device 600 determines that the data being recorded for the web-callingapplication is the first type of data (e.g., because the data beingrecorded for the web-calling application is available to be played backby John's device), using one or more similar techniques to thosediscussed above. As illustrated in FIG. 10G, device 600 does not displayan additional recording status indicator. Device 600 does not display anadditional recording status indicator because recording status indicator1042 is already displayed (e.g., or a predetermined number of recordingstatus indicators are displayed) due to the first type of data beingrecording for the voice memos application. In some embodiments, whendevice 600 is not displaying recording status indicator 1042 before datais recorded for the web-calling application, device 600 displays therecording status indicator 1042 in response to detecting tap gesture1050 f. At FIG. 10G, device 600 detects downward swipe gesture 1050 g.

As illustrated in FIG. 10H, in response to detecting downward swipegesture 1050 g, device 600 displays control user interface 1038. Controluser interface 1038 includes device controls 1046 for modifying a stateof device 600, such as a connectivity setting (e.g., wireless, cellular,Bluetooth setting). In addition, control user interface 1038 includesweb-calling recording status indicator 1044 a and voice memos recordingstatus indicator 1044 b because device 600 is concurrently capturing thefirst type of data for the web-calling application (e.g., a third-partyapplication) and the voice memos application. Web-calling recordingstatus indicator 1044 a and voice memos recording status indicator 1044b are displayed because device 600 is displaying control user interface1038. The recording status indicators of FIG. 10H each include morevisual content more content than recording status indicator 1042illustrated in FIG. 10G. In addition, device 600 displays multiplerecording status indicators on control user interface 1038 while onlydisplaying one recording status indicator when the control userinterface 1038 was not displayed (e.g., in FIG. 10G). In someembodiments, in response to detecting downward swipe gesture 1050 g,device 600 displays an animation of recording status indicator 1042transitioning into one or both of recording status indicator 1044 a andvoice memos recording status indicator 1044 b.

Web-calling recording status indicator 1044 a includes applicationindication 1044 a 1, device indication 1044 a 2, and configurationindication 1044 a 3. Application indication 1044 a 1 indicates theapplication for which device 600 is recording the first type of data(e.g., web-calling application). Device indication 1044 a 2 indicatesthat a microphone of device 600 is being used to record the first typeof data for the web-calling application. Moreover, configurationindication 1044 a 3 indicates that web-calling recording statusindicator 1044 a is selectable. Voice memos recording status indicator1044 b includes similar indications, such as application indication 1044b 1 (e.g., that indicates that the first type of data is being recordedfor the voice memos application) and device indication 1044 b 2 (e.g.,that indicates that a microphone of device 600 is being used to recordthe first type of data for the voice memos application). However, asillustrated in FIG. 10H, voice memos recording status indicator 1044 bdoes not include a configuration indication.

At FIG. 10H, voice memos recording status indicator 1044 b does notinclude a configuration indication because a determination is made thatthe voice memos application is not the type of application that isconfigurable (e.g., does not have configurable permission forenabling/disabling access to a media-capturing device) via control userinterface 1038. On the other hand, web-calling recording statusindicator 1044 a includes configuration indication 1044 a 3 because adetermination is made that web-calling application is the type ofapplication that is configurable via control user interface 1038. Insome embodiments, device 600 detects tap gesture 1050 h 1 on voice memosrecording status indicator 1044 b. In some embodiments, in response todetecting tap gesture 1050 h 1, device 600 continues to display controluser interface 1038 without displaying any additional content becausevoice memos recording status indicator 1044 b is not selectable. At FIG.10H, device 600 detects tap gesture 1050 h 2 on web-calling recordingstatus indicator 1044 a.

As illustrated in FIG. 10I, in response to detecting tap gesture 1050 h2, device 600 ceases to display control user interface 1038 and displaysa permission management user interface for the web-calling applicationthat includes permission controls 1052. Notably, because control userinterface 1038 has ceased to be displayed, device 600 also ceases todisplay separate recording status indicators for the web-calling andvoice memos applications (e.g., web-calling recording status indicator1044 a and voice memos recording status indicator 1044 b) and displays asingle or combined recording status indicator (e.g., recording statusindicator 1042) for the applications.

As illustrated in FIG. 10I, permission controls 1052 includes microphoneaccess affordance 1052 a and camera access affordance 1052 b, which areboth active (e.g., “ON”). In some embodiments, in response to detectinga tap gesture on microphone access affordance 1052 a, device 600 ceasesto allow data to be recorded for, via the microphone of device 600, theweb-calling application and also ceases to record the first type of datafor the web-calling application that begin being recording in responseto detecting input gesture 1050 f In some embodiments, in response todetecting a tap gesture on camera access affordance 1052 a, device 600ceases to allow data to be recorded for, via the camera of device 600,the web-calling application. At FIG. 10I, device 600 detects rightwardswipe gesture 1050 i on the bottom of the permission management userinterface.

As illustrated in FIG. 10J, in response to detecting rightward swipegesture 1050 i, device 600 re-displays the user interface with endaffordance 1034. At FIG. 10J, device 600 detects tap gesture 1050 j onend affordance 1034.

As illustrated in FIG. 10K, in response to detecting tap gesture 1050 j,device 600 stops recording the first type of data for the web-callingapplication (e.g., via the microphone of device 600) and displays a userinterface of the web-calling application that indicates that the callhas ended. Notably, in FIG. 10K, device 600 continues to displayrecording status indicator 1042 because the first type of data hascontinued to be recorded for the voice memos application, although thefirst type of data has stopped being recorded for the web-callingapplication. At FIG. 10K, device 600 detects upward swipe gesture 1050 kon the user interface of the web-calling application that indicates thatthe call has ended.

As illustrated in FIG. 10L, in response to detecting upward swipegesture 1050 k, device 600 displays the user interface with icons 690while continuing to display recording status indicator 1042, using oneor more similar techniques as discussed above (e.g., in FIG. 10E). Asillustrated in FIG. 10L, icons 690 include camera application icon 690a. At FIG. 10L, device 600 detects tap gesture 10501 on cameraapplication icon 690 a.

As illustrated in FIG. 10M, in response to detecting tap gesture 10501,device 600 displays a camera user interface. The camera user interfaceillustrated in FIG. 10M is displayed using one or more similartechniques as described above in relation to the camera user interfaceof FIG. 6A. For example, the camera user interface of FIG. 10M includesindicator region 602, camera display region 604, and control region 606.Camera display region 604 includes live preview 630, and control region604 includes camera mode affordances 620 and shutter affordance 610. Asillustrated in FIG. 10M, video camera mode affordance 620 b is centered(e.g., and “Video” is bolded), which indicates that device 600 isconfigured to record data representative of video media in response toreceiving a selection of shutter affordance 610. At FIG. 10M, device 600detects tap gesture 1050 m on shutter affordance 610.

As illustrated in FIG. 10N, in response to detecting tap gesture 1050 m,device 600 starts recording data for the camera application via one ormore cameras of device 600. At FIG. 10N, a determination is made thatthe data being recorded for the camera application is a first type ofdata (e.g., because the data being recorded is available for laterplayback), using one or more similar techniques discussed above. At FIG.10N, device 600 does not display an additional recording statusindicator (e.g., in addition to recording status indicator 1042) becausedevice 600 is not currently displaying control user interface 1038(e.g., and for similar reasons, as discussed above in relation to FIG.10G). At FIG. 10N, device 600 detects downward swipe gesture 1050 n thatstarts near the top of the camera user interface.

As illustrated in FIG. 10O, in response to detecting downward swipegesture 1050 n, device 600 re-displays control user interface 1038.Control user interface 1038 includes voice memos recording statusindicator 1044 b and camera recording status indicator 1044 c. Camerarecording status indicator 1044 c includes device identifier 1044 c 2,which is different from device identifier 1044 b 2 (e.g., of voice memosrecording status indicator 1044 b) because device 600 is using one ormore cameras to record the first type of data for the camera applicationas opposed to using the microphone to record the first type of data.Voice memos recording status indicator 1044 b and camera recordingstatus indicator 1044 c are concurrently displayed because device 600 isconcurrently recording the first type of data for both applications(e.g., using one or more similar techniques as discussed above inrelation to FIG. 10H).

FIG. 10P illustrates a different version of control user interface 1038that can be displayed in response to detecting downward swipe gesture1050 n. Control user interface 1038 of FIG. 10P includes additionalindications (e.g., “IS CURRENTLY USING”) of the current state of eachrespective applications use (e.g., voice memos application, cameraapplication) of a respective device (e.g., microphone, camera). However,control user interface 1038 does not include the additional indications.In some embodiments, because the additional indications take up morespace in the control user interface, device 600 can display theadditional indications when the first type of data is being recorded forless than a threshold number (e.g., 1, 2) of applications (and/ordevices) or when a threshold number of recording status indicators areconcurrently displayed. Turning back to FIG. 10O, device 600 detectsupward swipe gesture 1050 o on control user interface 1038.

As illustrated in FIG. 10Q, in response to detecting swipe gesture 1050o, device 600 re-displays the camera user interface that includes stopaffordance 614. At FIG. 10Q, device 600 detects tap gesture 1050 q onstop affordance 614. As illustrated in FIG. 10R, in response todetecting tap gesture 1050 q, device 600 ceases to record datarepresenting video media. At FIG. 10R, device 600 detects swipe gesture1050 r on the camera user interface.

As illustrated in FIG. 10S, in response to detecting swipe gesture 1050r, device 600 displays control user interface 1038. As shown in FIG.10S, control user interface 1038 continues to display camera recordingstatus indicator 1044 c, although device 600 is no longer recording thefirst type of data for the camera application. In FIG. 10S, device 600updates camera recording status indicator 1044 c to indicate that thecamera application was recently used (e.g., “Recently” in FIG. 10S), asopposed to camera recording status indicator 1044 c being displayedwithout an additional indication in FIG. 10O and/or with an additionalindication (“is currently using”) in FIG. 10P. Moreover, in FIG. 10S,device 600 continues to display voice memos recording status indicator1044 b because device 600 is still recording the first type of data forthe voice memos application (e.g., using one or more techniques and/orfor similar reasons as described above). At FIG. 10S, device 600 detectsrightward swipe gesture 1050 s on the bottom of control user interface1038.

As illustrated in FIG. 10T, in response to detecting rightward swipegesture 1050 s, device 600 displays the audio recording user interfacethat includes stop affordance 1016. At FIG. 10S, device 600 detects tapgesture 1050 t on stop affordance 1016. In some embodiments, in responseto detecting tap gesture 1050 t, device 600 stops recording the firsttype of data for the voice memos application. In some embodiments, afterstopping to record the first type of data for the voice memosapplication, device 600 ceases to display recording status indication1042 because device 600 is no longer recording the first type of data.

As illustrated in FIG. 10U (e.g., at some period of time afterdisplaying the audio recording user interface), device 600 displays thecamera user interface. At FIG. 10U, device 600 is operating in a “photo”camera mode, which is indicated by photo camera mode affordance 620 cbeing centered and “Photo” being bolded.

As discussed above in relation to FIG. 6A, device 600 displays livepreview 630 by recording data in the field-of-view of one or morecameras of device 600 (“the FOV”). Thus, at FIG. 10U, device 600 makes adetermination that the data that device 600 is recording to display livepreview 630 is the first type of data (e.g., because the data beingrecorded to display live preview 630 can be available for later playbackas shown by live preview 630), using one or more techniques as discussedabove. As illustrated in FIG. 10U, device 600 displays recording statusindicator 1042 because the determination is made that the data thatdevice 600 is recording to display live preview 630 is the first type ofdata. In some embodiments, device 600 does not display recording statusindicator 1042 at FIG. 10U. In some embodiments device 600 does notdisplay recording status indicator 1042 because a differentdetermination is made—that the data being recording to display livepreview 630 is not the first type of data (e.g., because the data beingrecorded is not available for playback at a later time), using one ormore similar techniques to those discussed above. At FIG. 10U, device600 detects tap gesture 1050 u on shutter affordance 610.

As illustrated in FIG. 10V, in response to detecting tap gesture 1050 u,device 600 records an image that is representative of live preview 630and updates media collection 612 to show a representation of an imagedthat was recorded (e.g., see the difference between media collection 612of FIG. 10U and FIG. 10V). At FIG. 10V, device 600 detects upward swipegesture 1050 v on the camera user interface.

As illustrated in FIG. 10W, in response to detecting swipe gesture 1050v, device 600 displays the user interface with icons 690. Whiledisplaying the user interface of FIG. 10W, device 600 continues todisplay recording status indicator 1042, although device 600 is notconcurrently capturing the first type of data for the cameraapplication. At FIG. 10W, device 600 displays recording status indicator1042 because recording status indicator 1042 is displayed for at least aminimum period of time after device 600 has recorded the first type ofdata for the camera application (e.g., data corresponding to the photothat was recorded in FIG. 10W). In other words, because recording datacorresponding to the recorded photo activated the camera (e.g., causedthe camera to recorded media) for less than a predetermined period oftime, device 600 displays recording status indicator 1042 for a minimumperiod of time and/or after the camera has ceased to record the firsttype of data. This a user recognize that an application has recorded thefirst type of data even when the application only records the first typeof data for a short period of time. As shown by FIG. 10W, recordingstatus indicator 1042 is displayed near (or adjacent to) one of thecameras (e.g., 1008) of device 600. At FIG. 10W, device 600 detectsdownward swipe gesture 1050 w on the user interface with icons 690.

As illustrated in FIG. 10X, in response to detecting downward swipegesture 1050 w, device 600 displays control user interface 1338. Asshown in FIG. 10X, control user interface 1338 includes camera recordingstatus indicator 1044 c, which indicates that the camera was recentlyused to record the first type of data. In FIG. 10X, control userinterface 1338 includes camera recording status indicator 1044 c becausecontrol user interface 1338 was displayed within a predetermined periodof time (e.g., 1-45 seconds) after recording the first type of data(e.g., the photo recorded in response to detecting tap gesture 1050 u)for the camera application. Thus, in some embodiments, control userinterface 1338 does not include camera recording status indicator 1044 cwhen control user interface 1338 is not displayed within a predeterminedperiod of time after the end of recording the first type of data for thecamera application.

FIG. 10Y illustrates device 600 displaying device 600 in a locked state,which is indicated by lock icon 1078 a. At FIG. 10Y, device 600 detects(e.g., via a camera with a FOV) a scene (e.g., a scene that includes aface of a user, a particular object) in the FOV that corresponds to datathat will unlock device 600. As illustrated in FIG. 10Z, in response todetecting the scene in the FOV that corresponds to data that will unlockdevice 600, device 600 changes from the locked state to an unlockedstate, which is indicated by unlock icon 1078 b.

Notably, at FIGS. 10Y-10Z, device 600 is recording data (e.g., using afirst-party trusted application), via a camera of device 600, in orderto identify a portion of a scene that will allow device 600 to change toan unlocked state. However, at FIGS. 10Y-10Z, device 600 does notdisplay recording status indicator 1042 because a determination is madethat the data being recorded by device 600 is not the first type ofdata. In FIGS. 10A-10B, device 600 is not recording the first type ofdata because the data that is being recorded is determined to be datathat will not be available for later playback. In particular, the databeing recording in FIGS. 10Y-10Z is not available for later playbackbecause device 600 is recording data to identify a portion of a scene inthe FOV that will allow device 600 to change to an unlocked state.

FIGS. 10AA-10AC illustrate device 1000 displaying user interface thatincludes capture status indicator 1042. Device 1000 optionally includesone or more components of device 100, device 300, and device 500described above.

As illustrated in FIG. 10AA, device 1000 is displaying a user interfacethat includes status bar 1022. At FIG. 10AA, because device 1000 isdisplaying a user interface that includes status bar 1022, device 1000displays capture status indicator 1042 in the status bar 1022 along withstatus indicators 1022 a-1022 e. Capture status indicator 1042 is theleftmost status indicator 1022 a-1022 e. In some embodiments, when astatus indicator is removed from status bar 1022, such as status barindicator 1022 c, the remaining status bar indicator moves to the rightto fill in the space vacated by the removed status indicator and capturestatus indicator 1042 remains the leftmost status indicator in statusbar. In some embodiments, when a status indicator is added to status bar1022, capture status indicator 1042 moves to the left and remains theleftmost status indicator in status bar 1022.

FIG. 10AB illustrates device 1000 displaying a user interface that doesnot include a status bar. At FIG. 10AA, because device 1000 is notdisplaying a status bar, device 1000 displays capture status indicator1042 in the upper right of the user interface, which is a differentlocation from which capture status indicator 1042 was displayed in 10AA(e.g., when status bar 1022 was displayed).

FIG. 10AC illustrates device 1000 displaying a user interface that doesnot include a status bar while device 1000 is in a different orientationthan device 1000 in FIG. 10AB. As illustrated in FIG. 10AC, device 1000capture status indicator 1042 in the upper right of the user interfacealthough device 600 is in a different orientation in FIG. 10AC ascompared to device 1000 in FIG. 10AB. Thus, when looking at FIGS.10AB-10AC, when no status bar is displayed device 1000 displays thecapture status indicator at the same position, irrespective device 600'sorientation.

FIG. 11 is a flow diagram illustrating a method for providing a statusindicator using a computer system in accordance with some embodiments.Method 1100 is performed at a computer system (e.g., 100, 300, 500, 600)having a first media-capturing device (e.g., one or more cameras (e.g.,dual cameras, triple camera, quad cameras, etc.) on the same side ordifferent sides of the computer system (e.g., a front camera, a backcamera), and/or one or more microphones, etc.) and is in communicationwith a display generation component (e.g., a display controller, atouch-sensitive display system) and one or more input devices (e.g., atouch-sensitive surface). Some operations in method 1100 are,optionally, combined, the orders of some operations are, optionally,changed, and some operations are, optionally, omitted.

As described below, method 1100 provides an intuitive way for providinga status indicator to a user of a computer system. The method reducesthe cognitive burden on a user for determining the status of one or moremedia capturing devices, thereby creating a more efficient human-machineinterface. For battery-operated computing systems, enabling a user tomanage the one or more media capturing devices faster and moreefficiently conserves power and increases the time between batterycharges.

The computer system (e.g., 600) (e.g., a smartphone, a smartwatch)receives (1102) an indication that the first media-capturing device hasbeen activated (e.g., recently activated (e.g., activated within apredetermined time (e.g., 1 or 2 seconds) before receiving theindication)). In some embodiments, the computer system receives anindication that the first media-capturing device has been activated bydetecting that the first media-capturing device is actively or has beenactively recording data (e.g., data that is representative of one ormore different types of media (e.g., audio, video, images (e.g., stillimages))). In some embodiments, the computer system receives anindication that the first media-capturing device (e.g., a video camera)by detecting that one or more applications are currently (or has beenusing) a camera or a microphone to capture or record media.

In response to (1104) receiving the indication that the firstmedia-capturing device has been activated and in accordance with (1106)a determination that, while activated, the first media-capturing devicerecorded data of a first type (e.g., within a first predetermined periodof time) (e.g., regardless of (e.g., independent of, withoutconsideration to) whether the media-capturing device recorded data of asecond type), the computer system displays (1108), via the displaygeneration component, a graphical indicator (e.g., 1042, 1044 a-1044 d)that indicates activation of the first media-capturing device. In someembodiments, data of a first type is data that is recorded, stored,retained, or is available (e.g., available to one or more applicationsthat caused the media-capturing device to record the data) as a mediaitem to be played back at a later time. In some embodiments, data of thefirst type is data that is readably accessible (e.g., via one or moreprograms or applications on the system) to be selected and played backby the user through one or more user inputs on a touch-sensitive displayof the computer system. In some embodiments, in accordance with adetermination that, while activated, the first media-capturing devicerecorded data of the first type (e.g., regardless of (e.g., independentof, without consideration to) whether the media-capturing devicerecorded data of a second type), the computer system ceases display of agraphical indicator that indicates that another media-capturing devicehas been activated. In some embodiments, the computer system replaces agraphical indicator that indicates that another media-capturing devicehas been activated with the graphical indicator that indicatesactivation of the first media-capturing device in accordance with adetermination that, while activated, the first media-capturing devicerecorded data of the first type. In some embodiments, data of the firsttype is data that is not being obtained and/or processed to determinewhether one or more triggering events (e.g., an audible phrase,presents/non-presents of a gaze of a user) has occurred. In someembodiments, the first type of data (e.g., the type of data for which acapture status indicator is displayed) corresponds to data that ispassed to a non-trusted application (e.g., a non-first-partyvoice-assistant application, a non-first-party authenticationapplication). In some embodiments, the recording status indicator isdisplayed independent of whether an indicator of recording is displayedby the application that is recording the data. Displaying the graphicalindicator when prescribed conditions are met (e.g., when amedia-capturing device records data of a first type (e.g., multimediadata)) allows the user to quickly recognize when a particular type ofdata is being (or has been) recorded and enables the user to takecertain actions based on whether the type of data is being (or has been)recorded. Performing an optimized operation when a set of conditions hasbeen met without requiring further user input enhances the operabilityof the system and makes the user-system interface more efficient (e.g.,by helping the user to provide proper inputs and reducing user mistakeswhen operating/interacting with the system) which, additionally, reducespower usage and improves battery life of the system by enabling the userto use the system more quickly and efficiently. Displaying the graphicalindicator when a media-capturing device records data of a first type(e.g., multimedia data) provides the user with feedback about the firstmedia-capturing device being active and recording data of the firsttype, which allows a user to be alerted to the recording of data of thefirst type. Providing improved visual feedback to the user enhances theoperability of the system and makes the user-system interface moreefficient (e.g., by helping the user to provide proper inputs andreducing user mistakes when operating/interacting with the system)which, additionally, reduces power usage and improves battery life ofthe system by enabling the user to use the system more quickly andefficiently.

In some embodiments, the first media-capturing device is a second typeof media-capturing device. In some embodiments, the computer systemdisplays (1110), concurrently with the graphical indicator, a thirdgraphical indicator (e.g., 1044 c) that is different from the graphicalindicator (e.g., 1044 b). In some embodiments, the graphical indicatorincludes an indication of the second type of media-capturing device; andthe third graphical indicator includes an indication of a third type ofmedia-capturing device that is different from the second type ofmedia-capturing device. In some embodiments, a fourth graphicalindicator is displayed with the graphical indicator. In someembodiments, the fourth graphical indication is associated with samemedia-capturing device (e.g., media-capturing device of the second type)as the graphical indication. In some embodiments, the graphicalindicator includes content that indicates that a first application isusing or has used the media-capturing device of the first type while thegraphical indicator includes content that indicates that a secondapplication that is different from the first application is using or hasused the media-capturing device of the first type. In some embodiments,in accordance with a determination that (or while) the computer systemis displaying a first user interface (e.g., a settings configurationuser interface), the third graphical indicator includes is displayed. Insome embodiments, in accordance with a determination that (or while) thecomputer system is displaying a second user interface that is not thefirst user interface (e.g., the settings configuration user interface),the third graphical indicator is not displayed. In some embodiments, thegraphical indicator and the third graphical indicator are displayedconcurrently (e.g., in response to receiving a first input (e.g., adragging input) and/or when displaying a user interface that includes aplurality of settings (e.g., for controlling one or more settings of thecomputer system)). Displaying a graphical indicator that shows that afirst type of media-capturing device (e.g., microphone) is capturingdata of the first and a graphical indication that shows that a secondtype of media capture device (e.g., camera) is capturing data of thesecond type provides the user with feedback concerning whether the firsttype of media-capturing device and the second type of media-capturingdevice are concurrently being used to capture data of the first type.Providing improved visual feedback to the user enhances the operabilityof the system and makes the user system interface more efficient (e.g.,by helping the user to provide proper inputs and reducing user mistakeswhen operating/interacting with the system) which, additionally, reducespower usage and improves battery life of the system by enabling the userto use the system more quickly and efficiently.

In response to (1104) receiving the indication that the firstmedia-capturing device has been activated and in accordance with adetermination that, while activated, the first media-capturing devicerecorded data of a second type (e.g., FIGS. 10A-10B, 10Y-10Z) (e.g.,that is different from the first type) without recording data of thefirst type (e.g., within the first predetermined period of time), thecomputer system forgoes (1112) display of the graphical indicator (e.g.,1042, 1044 a-1044 d) that indicates activation of the firstmedia-capturing device. In some embodiments, data of the second type isdata that is being obtained and/or processed to determine whether one ormore triggering event (e.g., an audible phrase, presents/non-presents ofa gaze of a user) has occurred. In some embodiments, data of the secondtype is data that is not stored as a media item (e.g., audio, videomedia) (and/or is not available) to be played back at a later time. Insome embodiments, data of the second type is data that is not readablyaccessible (e.g., via one or more programs or application on the system)to be selected and played back by the user through one or more userinputs on a touch-sensitive display of the computer system. In someembodiments, the second type of data (e.g., the type of data for which acapture status indicator is not displayed) corresponds to data that isused to control various features of the device by one or more trustedapplications (e.g., components of the operating system or trusted firstparty and/or third party applications) without being passed to anon-trusted application (e.g., a non-first party voice-assistantapplication, a non-authentication application) and without beingretained as media that can be played back at a later time (e.g., eitherby the device or by another device). In some embodiments, in accordancewith a determination that, while activated, the first media-capturingdevice has not recorded any data, the computer system forgoes display ofthe graphical indicator that indicates that the one or media-capturingdevices have been activated. In some embodiments, in accordance with adetermination that, while activated, the first media-capturing devicerecorded data of a second without recording data of the first type, thecomputer system ceases display of a graphical indicator that indicatesthat another media-capturing device has been activated. Not displayingthe graphical indicator when a media-capturing device records data of asecond type (e.g., metadata) provides the user with feedback that thefirst media-capturing device is not active and/or is not recording dataof the first type, which allows the user to not be unnecessarily alertedto the recording of data of the second type. Providing improved visualfeedback to the user enhances the operability of the device and makesthe user-device interface more efficient (e.g., by helping the user toprovide proper inputs and reducing user mistakes whenoperating/interacting with the device) which, additionally, reducespower usage and improves battery life of the device by enabling the userto use the device more quickly and efficiently.

In some embodiments, the recorded data of the second type (e.g., FIGS.10A-10B and FIGS. 10Y-10Z) (e.g., data captured by a native or trustedvoice assistant application using a media-capturing device of thecomputer system, data captured by an application, using amedia-capturing device of the computer system, that causes the computersystem to perform a function, such as unlocking/locking the computersystem (e.g., via capturing one or more features (e.g., voice, face,biometric data) associated with the user of the system or react (e.g.,providing information in response to) to one or more voice commands)corresponds to data that is not available for playback (e.g., data thatis not stored to be available for playback (e.g., output by one or moreoutput devices (e.g., camera, microphones, displays (e.g., displaygeneration components) at the computer system and/or another device)),transitory data that is, for example, data that is not transmitted toexternal devices and that is not stored locally for subsequenttransmission to external devices (or for local user playback), data thatis used to control various features of the device by one or more trustedapplications (e.g., components of the operating system or trustedfirst-party and/or third-party applications) without being passed to anon-trusted application (e.g., a non-first-party voice-assistantapplication, a non-first-party authentication application) and withoutbeing retained as media that can be played back at a later time (e.g.,either by the device or by another device).

In some embodiments, the recorded data of the first type (e.g., 10C-10V)(e.g., data associated with a third-party or a non-trusted social mediaapplication using a media-capturing device of the computer system, datacaptured by an audio/video capturing application, using amedia-capturing device of the computer system, that provides audio/videofor playback at the device or at an external device, an application thatdoes not cause the computer system to perform a function, such asunlocking/locking the computer system (e.g., via capturing one or morefeatures (e.g., voice, face, biometric data) associated with the user ofthe device), reacting (e.g., providing information in response to) toone or more voice commands) corresponds to data that is available (e.g.,readily available (e.g., available via one or more user inputs receivedwhile displaying the application that associated with the firstmedia-capturing is displayed)) for playback (e.g., data that is storedto be available for playback (e.g., output by one or more output devices(e.g., camera, microphones, displays (e.g., display generationcomponents) at the computer system and/or another device)), data that isnot transitory data, data that is transmitted to external devices and/orthat is stored locally for subsequent transmission to external devices(or for local user playback), data that is passed to a non-trustedapplication (e.g., a non-first-party voice-assistant application, anon-first-party authentication application).

In some embodiments, the graphical indicator (e.g., 1042) (e.g., acircle (e.g., a circle with a solid color, a circle with hatching), atriangle, a square, any other suitable shape) is displayed irrespectiveof whether a status bar (e.g., user interface object that is alignedwith the an edge of the displayable area, that includes a current time,that indicates a signal strength, and/or that includes a battery status)is displayed. In some embodiments, while a status bar is displayed, thegraphical indicator is currently displayed in the status bar. In someembodiments, while the graphical indicator is currently displayed in thestatus bar, the computer system receives an indication to cease todisplay the status bar (e.g., full-screen display of an application);and in response to receiving the indication to cease to display thestatus bar, the computer system ceases to display the status bar whilecontinuing to display the graphical indicator. In some embodiments,while the status bar is not displayed and the graphical indicator isdisplayed, the computer system receives an indication to display thestatus bar; and in response to receiving the indication to display thestatus bar, the computer system displays the status bar while continuingto display the graphical indicator. Displaying the graphical indicatorirrespective of whether a status bar is displayed provides the user withconsistent feedback, when applicable, regarding whether amedia-capturing device is recording data of the first type (e.g.,multimedia data) and independent of whether a particular user interfaceelement is concurrently displayed. Providing improved visual feedback tothe user enhances the operability of the system and makes theuser-system interface more efficient (e.g., by helping the user toprovide proper inputs and reducing user mistakes whenoperating/interacting with the system) which, additionally, reducespower usage and improves battery life of the system by enabling the userto use the system more quickly and efficiently.

In some embodiments, the graphical indicator (e.g., 1042) is displayedat a position (e.g., of a displayable area, on a user interface (e.g., auser interface that is currently being displayed by the displaygeneration component)) that is adjacent to at least one media-capturingdevice (e.g., a camera sensor, a microphone, at least one of themedia-capturing devices of the one or more media-capturing devices ofthe computer system). Displaying the graphical indicator at a positionthat is adjacent to the media-capturing device provides the user withfeedback allows the user to have a better understanding with respect tothe functionality and purpose of the graphical indicator (e.g., thegraphical indicator corresponds to the status (e.g., active status ofcapturing) of the media-capturing device that is it adjacent thegraphical indicator). Further, displaying the graphical indicator at aposition that is adjacent to the media-capturing device avoidsunnecessarily obstructing other user interface objects and informationdisplayed via the computer system. Providing improved visual feedback tothe user enhances the operability of the system and makes theuser-system interface more efficient (e.g., by helping the user toprovide proper inputs and reducing user mistakes whenoperating/interacting with the system) which, additionally, reducespower usage and improves battery life of the system by enabling the userto use the system more quickly and efficiently.

In some embodiments, the graphical indicator (e.g., 1042), in accordancewith a determination that a status bar (e.g., 1022) (e.g., userinterface object of a first type) is not currently displayed, isdisplayed at a first position (e.g., a position that is in (e.g.,adjacent, at) a corner (e.g., upper left hand corner, upper rightcorner, lower left hand corner, lower right hand corner) of a userinterface) (e.g., a user interface that is currently being displayed bythe display generation component). In some embodiments, the graphicalindicator (e.g., 1042), in accordance with a determination that thestatus bar (e.g., 1022) (e.g., user interface object of a first type) isnot currently displayed, is displayed at a second position that isdifferent from the first position (e.g., at a position that is not in ornear the corner of the user interface). In some embodiments, the displayposition of the graphical indicator changes based on whether the statusbar is displayed. Displaying the graphical indicator in differentpositions based on different prescribed conditions being met providesthe user with feedback concerning whether the media-capturing device isrecording data of the first type (e.g., multimedia data) in anunobtrusive manner such that other user interface objects andinformation are not obscured by display of the graphical indicator.Providing improved visual feedback to the user enhances the operabilityof the system and makes the user-system interface more efficient (e.g.,by helping the user to provide proper inputs and reducing user mistakeswhen operating/interacting with the system) which, additionally, reducespower usage and improves battery life of the system by enabling the userto use the system more quickly and efficiently.

In some embodiments, while displaying the graphical indicator (e.g.,1042), the computer system receives (e.g., via the one or more inputdevices) a first input (e.g., 1050 g, 1050 n, 1050 v) (e.g., a firstuser input, a dragging gesture). In some embodiments, in response toreceiving the first input (e.g., 1050 g, 1050 n, 1050 v), the computersystem displays a user interface (e.g., a settings configuration userinterface (e.g., a user interface that includes a plurality ofselectable user interface objects that, when selected, control aplurality of functions (e.g., modes) of the computer system (e.g.,turn/off Wi-Fi, Blue-tooth, an airplane mode, a night mode, a screenlock mode, a flash light mode) (e.g., increase/decrease a display screenbrightness, a sound level))) that includes a second graphical indicatorthat indicates activation of the first media-capturing device. In someembodiments, the second graphical indicator is different from thegraphical indicator. In some embodiments, in response to receiving thefirst user input, the graphical indicator ceases to be displayed. Insome embodiments, the second graphical indicator is not displayedconcurrently with the graphical indicator. In some embodiments, thesecond graphical indicator is displayed with a graphical indicator (orone or more other graphical indicator) that indicates activation of amedia-capturing device that is different from the first media-capturingdevice or is a different type (e.g., a microphone, a camera) ofmedia-capturing device than the first media-capturing device.

In some embodiments, the second graphical indicator (e.g., 1044 a-1044d) includes displayed content that is different from (e.g., greater than(e.g., a greater number of characters, icons, and/or information))displayed content of the graphical indicator (e.g., 1042). Displayinggraphical indicators that indicates the same activation of the samemedia-capturing device that is recording the same data of the first typeprovides the user with a constant visual feedback with respect towhether the media-capturing device is actively recording data of thefirst type and provides the user with greater flexibility with respectto how the user operates the computer system while the media-capturingdevice is actively recording data of the first type (e.g., whendifferent user interfaces are displayed). Providing improved visualfeedback to the user enhances the operability of the system and makesthe user system interface more efficient (e.g., by helping the user toprovide proper inputs and reducing user mistakes whenoperating/interacting with the system) which, additionally, reducespower usage and improves battery life of the system by enabling the userto use the system more quickly and efficiently. Displaying the secondgraphical indicator that includes displayed content that is differentfrom displayed content of the graphical indicator provides the user withmore information with respect to the recording state of themedia-capturing device that is active which results in the user havingan enhanced understanding of the operating status of the media-capturingdevices. Providing improved visual feedback to the user enhances theoperability of the system and makes the user system interface moreefficient (e.g., by helping the user to provide proper inputs andreducing user mistakes when operating/interacting with the system)which, additionally, reduces power usage and improves battery life ofthe system by enabling the user to use the system more quickly andefficiently.

In some embodiments, the first media-capturing device is a first type(e.g., a microphone, a camera) of media-capturing device. In someembodiments, displayed content of the graphical indicator (e.g., 1044a-1044 d) includes an indication (e.g., 1044 a 2, 1044 b 2, 1044 c 2)(e.g., images, text) of the first type of media-capturing device. Insome embodiments, the first media-capturing device is a second type ofmedia-capturing device and the content of the graphical indicatorincludes an indication of the second-type of media-capturing device. Insome embodiments, in accordance with a determination that (or while) thecomputer system is displaying a first user interface (e.g., a settingsconfiguration user interface), the graphical indicator includes anindication of the first type of media-capture device. In someembodiments, in accordance with a determination that (or while) thecomputer system is displaying a second user interface that is not thefirst user interface (e.g., the settings configuration user interface),the graphical indicator does not include the indication of the firsttype of media-capture device. In some embodiments, the graphicalindicator includes a camera/camcorder image when the firstmedia-capturing device is a camera sensor and the graphical indicatorincludes a microphone image when the first media-capturing device is anaudio microphone. Displaying a graphical indicator that includes anindication of the type of media capturing device provides the user withvisual feedback as to the type (e.g., a microphone, a camera) ofmedia-capturing device that is recording data, which allows the usermore accurately determine the type of data (e.g., audio data, visualdata) that is being recorded by the media-capturing device. Providingimproved visual feedback to the user enhances the operability of thesystem and makes the user system interface more efficient (e.g., byhelping the user to provide proper inputs and reducing user mistakeswhen operating/interacting with the system) which, additionally, reducespower usage and improves battery life of the system by enabling the userto use the system more quickly and efficiently.

In some embodiments, displayed content of the graphical indicatorincludes an indication (e.g., display of the graphical indicatorincludes a representation (e.g., a textual indication, graphicalindication) of an application) of an application (e.g., 1044 b, 1044 cin FIG. 10P) (or process or function) that is currently recording datavia (e.g., or that is currently using) the first media-capturing device.In some embodiments, in accordance with a determination that (or while)the computer system is displaying a first user interface (e.g., asettings configuration user interface), the graphical indicator includesan indication (e.g., name, shortcut icon) of an application that iscurrently recording data via the first media-capturing device. In someembodiments, in accordance with a determination that (or while) thecomputer system is displaying a second user interface that is not thefirst user interface (e.g., the settings configuration user interface),the graphical indicator does not include an indication of theapplication that is currently recording data via the firstmedia-capturing device. Displaying a graphical indicator that includesan indication of the application that is currently recording data of thetype via the first media-capturing device provides the user withinformation, which allows the user to determine the application thatactivated the first media-capturing device, the context as to why (e.g.,functionality of the application) the first media-capturing device isrecording data, and the type of data (e.g., audio data, image data)being recorded. Providing improved visual feedback to the user enhancesthe operability of the system and makes the user system interface moreefficient (e.g., by helping the user to provide proper inputs andreducing user mistakes when operating/interacting with the system)which, additionally, reduces power usage and improves battery life ofthe system by enabling the user to use the system more quickly andefficiently.

In some embodiments, displayed content of the graphical indicatorincludes an indication of an application that has previously recordeddata (e.g., 1044 c in FIG. 10S) (e.g., within a predetermined timethreshold of the current time even if the application is not currentlyrecording data) via the first media-capturing device. In someembodiments, in accordance with a determination that (or while) thecomputer system is displaying a first user interface (e.g., a settingsconfiguration user interface), the graphical indicator includes anindication of an application that has previously recorded data via thefirst media-capturing device. In some embodiments, in accordance with adetermination that (or while) the computer system is displaying a seconduser interface that is not the first user interface (e.g., the settingsconfiguration user interface), the graphical indicator does not includean indication of an application that has previously recorded data viathe first media-capturing device. In some embodiments, after a period oftime, the graphical indicator ceases to be displayed (or the display ofthe graphical indicator times-out). In some embodiments, the graphicalindicator can be replaced by a more recent graphical indicator. In someembodiments, a graphical indicator that indicates that a firstapplication is using the camera (or microphone) can be replaced by agraphical indicator that a second application is using the camera (ormicrophone). Displaying a graphical indicator that includes anindication of the application that was recording data provides the userwith visual feedback as to which application was recording data, whichprovides the user with information to determine the application thatactivated the media-capturing device and/or received the recorded data.Providing improved visual feedback to the user enhances the operabilityof the system and makes the user system interface more efficient (e.g.,by helping the user to provide proper inputs and reducing user mistakeswhen operating/interacting with the system) which, additionally, reducespower usage and improves battery life of the system by enabling the userto use the system more quickly and efficiently.

In some embodiments, in response to receiving the first user input andin accordance with a determination that the graphical indicator doescorrespond to an application of a first application type, the graphicalindicator (e.g., 1044 a) is selectable (e.g., 1044 a 3) (e.g., isavailable to be activated (e.g., initiates the computer system toperform an action in response) via one or more user inputs). In someembodiments, in response to receiving the first user input and inaccordance with a determination that the graphical indicator does notcorrespond to an application of the first application type, thegraphical indicator is not selectable (e.g., is not available to beactivated (e.g., initiates the computer system to perform an action inresponse) via one or more user inputs). In some embodiments, whiledisplaying the graphical indication that is selectable, receiving a userinput (e.g., a tap) corresponding to (e.g., on) selection of thegraphical indication and in response to receiving the user inputcorresponding to the selection of the graphical indication, displaying athird user interface for managing one or more permissions of theapplication of the first application type (e.g., increasing, reducing,or revoking permissions such as changing circumstances under which theapplication is permitted to use the camera and/or microphone). In someembodiments, the third user interface includes one or more selectableuser interface objects, that when selected, stops the application fromrecording (e.g., in the future and/or currently) data using amedia-capturing device. Having the graphical indicator be selectablewhen prescribed conditions are met (e.g., the graphical indicatorcorresponds to a first type of application) provides the user with morecontrol over the system by allowing the user to more efficiently andeasily adjust the settings (e.g., revoke the applications ability toaccess the first media capture device) when allowed (e.g., when thefirst type of application is capturing media via the media-capturingdevice). Providing additional control of the system without clutteringthe UI with additional displayed controls enhances the operability ofthe system makes the user-system interface more efficient (e.g., byhelping the user to provide proper inputs and reducing user mistakeswhen operating/interacting with the system) which, additionally reducespower usage and improves battery life of the system by enabling the userto use the system more quickly and efficiently.

In some embodiments, the computer system receives (e.g., via the one ormore input devices) a third user input (e.g., a dragging gesture). Insome embodiments, in response to receiving the third user input, thecomputer system displays a user interface that, (e.g., a settingsconfiguration (e.g., a user interface that includes a plurality ofselectable user interface objects that, when selected, control aplurality of functions (e.g., modes) of the system (e.g., turn/offWi-Fi, Blue-tooth, an airplane mode, a night mode, a screen lock mode, aflash light mode) (e.g., increase/decrease a display screen brightness,a sound level))) in accordance with a determination that the third userinput was received while the first media-capturing device continues tobe activated or within a predetermined of time (e.g., 1 second, 3seconds, 10 seconds, 20 seconds, 30 seconds) after the firstmedia-capturing device has been active (e.g., the first media-capturedevice is currently deactivated), includes the graphical indication(e.g., 1044 d) that indicates activation of the first media-capturingdevice. In some embodiments, in response to receiving the third userinput, the computer system displays a user interface that, (e.g., asettings configuration (e.g., a user interface that includes a pluralityof selectable user interface objects that, when selected, control aplurality of functions (e.g., modes) of the system (e.g., turn/offWi-Fi, Blue-tooth, an airplane mode, a night mode, a screen lock mode, aflash light mode) (e.g., increase/decrease a display screen brightness,a sound level))), in accordance with a determination that the third userinput was not received while the first media-capturing device continuesto be activated or within a predetermined of time after the firstmedia-capturing device has been active, does not include display of thegraphical indicator that indicates activation of the firstmedia-capturing device.

In some embodiments, the graphical indicator is displayed for at least aminimum (e.g., 1044 d) (e.g., 1 seconds, 2 seconds, 3 seconds) period oftime. In some embodiments, the graphical indicator is displayed for aminimum period of time even if the first media-capturing device has notbeen activated (e.g., while captured a photo) for the minimum period oftime. In some embodiments, when the first media-capturing device hasbeen activated for a period of time exceeding the minimum period oftime, the graphical indicator is displayed for the period of time thefirst media-capturing device was active; and when the firstmedia-capturing device has been activated for a period of time notexceeding the minimum period of time, the graphical indicator isdisplayed for the minimum period of time (e.g., the graphical indicatoris displayed even after the application has stopped using the cameraand/or microphone to ensure that the graphical indicator is displayedfor at least the minimum period of time which provides the user with theopportunity to see the graphical indicator and prevents applicationsfrom using the camera and/or microphone for short periods of time toavoid the user noticing the graphical indicator). Displaying thegraphical indicator for at least a minimum period of time provides theuser with a greater opportunity to view the graphical indicator anddecreases any confusion the user may have as to whether the graphicalindicator was displayed or not displayed when the first media-capturingdevice was activated for less than the minimum period of time. Providingimproved visual feedback to the user enhances the operability of thesystem and makes the user system interface more efficient (e.g., byhelping the user to provide proper inputs and reducing user mistakeswhen operating/interacting with the system) which, additionally, reducespower usage and improves battery life of the system by enabling the userto use the system more quickly and efficiently.

In some embodiments, the graphical indicator (e.g., 1044 a) is displayedfor a length of time that is based on a length of time for which thefirst media-capturing device has been active. In some embodiments, thelength of time that the graphical indicator is displayed is based on thelength of time for which the first-media-capturing device has beenactive. In some embodiments, the graphical indicator is displayed forlonger than the length of time that the first media-capturing device hasbeen capturing a video (e.g., when the first media device has not beenactivated to capture the video for over a predetermined period of time(e.g., 1 second, 2 seconds)). Displaying the graphical indicator for atleast a length of time that is based on the time for which the firstmedia-capturing device has been active provides the user with a betterunderstanding regarding the duration of how long the firstmedia-capturing device has been recording data of the first type, whichallows the user to more accurately ascertain what the firstmedia-capturing device has recorded. Providing improved visual feedbackto the user enhances the operability of the system and makes the usersystem interface more efficient (e.g., by helping the user to provideproper inputs and reducing user mistakes when operating/interacting withthe system) which, additionally, reduces power usage and improvesbattery life of the system by enabling the user to use the system morequickly and efficiently.

In some embodiments, the display location of the graphical indicator(e.g., 1042) does not change, regardless of applications or functionsthat are running or are displayed. In some embodiments, the graphicalindicator is displayed in multiple positions on a device that is not atablet device, such as a smartphone (e.g., based on whether the settingsconfiguration user interface is displayed or not). In some embodiments,the graphical indicator is displayed in the same position on a devicethat is a tablet device (e.g., regardless of whether the settingsconfiguration user interface is displayed or not).

Note that details of the processes described above with respect tomethod 1100 (e.g., FIG. 11) are also applicable in an analogous mannerto the methods described below/above. For example, method 1100optionally includes one or more of the characteristics of the variousmethods described above with reference to methods 700 and 900. Forexample, method 1100 displays a status indicator that can alert a userthat media is being captured that can be displayed via step 902 and/orstep 910 of method 900. For brevity, these details are not repeatedbelow.

The foregoing description, for purpose of explanation, has beendescribed with reference to specific embodiments. However, theillustrative discussions above are not intended to be exhaustive or tolimit the invention to the precise forms disclosed. Many modificationsand variations are possible in view of the above teachings. Theembodiments were chosen and described in order to best explain theprinciples of the techniques and their practical applications. Othersskilled in the art are thereby enabled to best utilize the techniquesand various embodiments with various modifications as are suited to theparticular use contemplated.

Although the disclosure and examples have been fully described withreference to the accompanying drawings, it is to be noted that variouschanges and modifications will become apparent to those skilled in theart. Such changes and modifications are to be understood as beingincluded within the scope of the disclosure and examples as defined bythe claims.

As described above, one aspect of the present technology is thegathering and use of data available from various sources to increase theoperability of the computer system and/or to allow the computer systemto perform various functions for the user, such as functions performedvia a native or trusted voice assistant application using amedia-capturing device of the computer system, unlocking/locking thecomputer system, reacting (e.g., providing information in response to)to one or more voice commands. The present disclosure contemplates thatin some instances, this gathered data may include personal informationdata that uniquely identifies or can be used identify a specific person.Such personal information data can include facial features, biometricdata, or any other identifying or personal information. The presentdisclosure recognizes that the use of personal information data, in thepresent technology, can be used to the benefit of users. For example,the personal information data can be used to provide various functionsto the user and/or increase the operability of the computer system.Accordingly, use of such personal information data enables users to havecontrol over the operability and/or functionality of the computersystem. Further, other uses for personal information data that benefitthe user are also contemplated by the present disclosure.

The present disclosure contemplates that the entities responsible forthe collection, analysis, disclosure, transfer, storage, or other use ofsuch personal information data will comply with well-established privacypolicies and/or privacy practices. In particular, such entities shouldimplement and consistently use privacy policies and practices that aregenerally recognized as meeting or exceeding industry or governmentalrequirements for maintaining personal information data private andsecure. Such policies should be easily accessible by users, and shouldbe updated as the collection and/or use of data changes. Personalinformation from users should be collected for legitimate and reasonableuses of the entity and not shared or sold outside of those legitimateuses. Further, such collection/sharing should occur after receiving theinformed consent of the users. Additionally, such entities shouldconsider taking any needed steps for safeguarding and securing access tosuch personal information data and ensuring that others with access tothe personal information data adhere to their privacy policies andprocedures. Further, such entities can subject themselves to evaluationby third parties to certify their adherence to widely accepted privacypolicies and practices. In addition, policies and practices should beadapted for the particular types of personal information data beingcollected and/or accessed and adapted to applicable laws and standards,including jurisdiction-specific considerations. For instance, in the US,collection of or access to certain health data may be governed byfederal and/or state laws, such as the Health Insurance Portability andAccountability Act (HIPAA); whereas health data in other countries maybe subject to other regulations and policies and should be handledaccordingly. Hence different privacy practices should be maintained fordifferent personal data types in each country.

Despite the foregoing, the present disclosure also contemplatesembodiments in which users selectively block the use of, or access to,personal information data. That is, the present disclosure contemplatesthat hardware and/or software elements can be provided to prevent orblock access to such personal information data. For example, in the caseof providing functionality that captures image data to unlock thedevice, the present technology can be configured to allow users toselect to “opt in” or “opt out” of participation in the collection ofpersonal information data during registration for services or anytimethereafter. In another example, users can select to not provide imagedata to unlock the device and, accordingly, the image data would not becollected. In other examples, it should be understood that the data thatis captured, monitored, and/or processed to be used to provide one ormore functions and/or or increase operability of the device is notstored to be played back by users of external devices in most instances.It should be also understood that the data that is captured, monitored,and/or processed to be used to provide one or more functions and/orincrease operability of the device is treated carefully with regards toits security and sharing of the respective data and user privacy ispreserved (e.g., the data is not shared with third-party applications).Moreover, in some examples, users can limit the amount of data that iscaptured, monitored, and/or processed to be used to provide one or morefunctions and/or or increase operability of the device. In addition toproviding “opt in” and “opt out” options, the present disclosurecontemplates providing notifications relating to the access or use ofpersonal information. For instance, a user may be notified upondownloading an app that their personal information data will be accessedand then reminded again just before personal information data isaccessed by the app.

Moreover, it is the intent of the present disclosure that personalinformation data should be managed and handled in a way to minimizerisks of unintentional or unauthorized access or use. Risk can beminimized by limiting the collection of data and deleting data once itis no longer needed. In addition, and when applicable, including incertain health related applications, data de-identification can be usedto protect a user's privacy. De-identification may be facilitated, whenappropriate, by removing specific identifiers (e.g., date of birth,etc.), controlling the amount or specificity of data stored (e.g.,collecting location data a city level rather than at an address level),controlling how data is stored (e.g., aggregating data across users),and/or other methods.

Therefore, although the present disclosure broadly covers use ofpersonal information data to implement one or more various disclosedembodiments, the present disclosure also contemplates that the variousembodiments can also be implemented without the need for accessing suchpersonal information data. That is, the various embodiments of thepresent technology are not rendered inoperable due to the lack of all ora portion of such personal information data. For example, functionalitycan be provided to the user based on non-personal information data or abare minimum amount of personal information, such as the content beingrequested by the device associated with a user, other non-personalinformation available to the, or publicly available information.

What is claimed is:
 1. A computer system, comprising: one or moremedia-capturing devices, wherein the computer system is in communicationwith a display generation component and one or more input devices; oneor more processors; and memory storing one or more programs configuredto be executed by the one or more processors, the one or more programsincluding instructions for: receiving an indication that the one or moremedia-capturing devices have been activated; and in response toreceiving the indication that the one or more media-capturing deviceshave been activated, displaying a respective user interface thatincludes: in accordance with a determination that the one or moremedia-capturing devices were activated by a first application, a firstgraphical indicator that indicates activation of at least one of the oneor more media-capturing devices and includes an indication of the firstapplication; and in accordance with a determination that the one or moremedia-capturing devices were activated by a second application that isdifferent from the first application, a second graphical indicator thatindicates activation of at least one of the one or more media-capturingdevices and includes an indication of the second application.
 2. Thecomputer system of claim 1, further comprising: while displaying therespective user interface, detecting a first input; and in response todetecting the first input: in accordance with a determination that thefirst input was directed to the first graphical indicator, displaying,via the display generation component, a first user interface thatincludes content of the first application; and in accordance with adetermination that the first input was directed to the second graphicalindicator, displaying, via the display generation component, a firstuser interface that includes content of the second application, whereinthe first user interface that includes content of the first applicationis different from the first user interface that includes content of thesecond application.
 3. The computer system of claim 1, wherein the firstgraphical indicator is concurrently displayed with the second graphicalindicator.
 4. The computer system of claim 1, wherein the firstgraphical indicator includes an indication of a first type ofmedia-capturing device that corresponds to at least one of the one ormore media-capturing devices, and wherein the second graphical indicatorincludes an indication of a second type of media-capturing device thatcorresponds to at least one of the one or more media-capturing devices.5. The computer system of claim 1, wherein at least one of theindication of the first application and the indication of the secondapplication is an indication of an application that is currentlyrecording data via the one or more media-capturing devices.
 6. Thecomputer system of claim 1, wherein at least one of the indication ofthe first application and the indication of the second application is anindication of an application that has previously recorded data via theone or more media-capturing devices.
 7. The computer system of claim 1,further comprising: while displaying the respective user interface,detecting a second input; and in response to detecting the second input:in accordance with a determination that the second input was directed tothe first graphical indicator, displaying, via the display generationcomponent, additional information corresponding to the first graphicalindicator; and in accordance with a determination that the second inputwas directed to the second graphical indicator, displaying, via thedisplay generation component, additional information corresponding tothe second graphical indicator, wherein the additional informationcorresponding to the second graphical indicator is different from theadditional information corresponding to the first graphical indicator.8. The computer system of claim 7, wherein the additional informationcorresponding to the first graphical indicator includes a settingcontrol that, when selected, causes a setting to be changed with respectto at least one of the one or more media-capturing devices and the firstapplication.
 9. The computer system of claim 7, further comprising:while displaying, via the display generation component, the additionalinformation corresponding to the first graphical indicator, detecting athird input; and in response to detecting the third input, displaying,via the display generation component, a second user interface thatincludes content of the first application.
 10. The computer system ofclaim 1, further comprising: while displaying the first graphicalindicator is concurrently displayed with the second graphical indicator,detecting a fourth input; and in response to detecting the fourth input,displaying a third graphical indicator while ceasing to display thefirst graphical indicator and the second graphical indicator, whereinthe third graphical indicator corresponds to at least one of the firstgraphical indicator and the second graphical indicator.
 11. The computersystem of claim 10, wherein the third graphical indicator does notinclude either of the indication of the first application and theindication of the second application.
 12. A non-transitorycomputer-readable storage medium storing one or more programs configuredto be executed by one or more processors of a computer system that is incommunication with one or more media-capturing devices, a displaygeneration component, and one or more input devices, the one or moreprograms including instructions for: receiving an indication that theone or more media-capturing devices have been activated; and in responseto receiving the indication that the one or more media-capturing deviceshave been activated, displaying a respective user interface thatincludes: in accordance with a determination that the one or moremedia-capturing devices were activated by a first application, a firstgraphical indicator that indicates activation of the one or moremedia-capturing devices and includes an indication of the firstapplication; and in accordance with a determination that the one or moremedia-capturing devices were activated by a second application that isdifferent from the first application, a second graphical indicator thatindicates activation of the one or more media-capturing devices andincludes an indication of the second application.
 13. A method,comprising: at a computer system that is in communication with one ormore media-capturing devices, a display generation component, and one ormore input devices: receiving an indication that the one or moremedia-capturing devices have been activated; and in response toreceiving the indication that the one or more media-capturing deviceshave been activated, displaying a respective user interface thatincludes: in accordance with a determination that the one or moremedia-capturing devices were activated by a first application, a firstgraphical indicator that indicates activation of the one or moremedia-capturing devices and includes an indication of the firstapplication; and in accordance with a determination that the one or moremedia-capturing devices were activated by a second application that isdifferent from the first application, a second graphical indicator thatindicates activation of the one or more media-capturing devices andincludes an indication of the second application.